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Abstract of JP2000232635 
PROBLEM TO BE SOLVED: To provide an 
operation capability higher than that for video 
data to a message transmitter by setting up a link 
between structure and video data in order to 
generate structured video message and 
transmitting the generated structured video 
message to a receiver. SOLUTION: In a video 
message transmitting station 100, higher 
capability including the capability of structured 
video capturing, video message editing and other 
operation is applied to the transmitting side 103 
but a linear (non- structured) video message is 
sent or provided to the video message receiving 
side. A representative capture device 102 
typically includes a video capture device related 
to a voice capture device. The capture device 
102 is connected to a general computer 101 such 
as a personal computer. 
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[0 0 2 3] *^©H1 7©«^C«fc*lli. &Bt©>> 

u < 1 ^<oj - mmse?** y-fe-s?© 
s. 

[0 0 2 4] $&J!©Jitl 8ffli*tEJ:*l«. Mfc©; 

-S?©*§&*a*tS#8fc, tWB^f^^yfe-yS: 
»SI©7*-vy hEtSfefcCW©;- F&iftfe* 

* 9 iz - *?©iz V F 3 1 &mt+&Bi 

SA^atis, 

[0 0 2 5] #3$)3©£l 9©JWWCJ:*tfi. Wi£>J . 

- Kfrftttiff 8 ** **-i?©*ft4: i/c*ws*t* * 

mst<D^u if 7 h ftMAt s =1 > tfa-^^m y "TIB 

©y-F&BMH"5fe*©a-Fi:&*U 
1-d(DJ~ FtttfflBtTr tf* vfe- s>©* ^ > 1" 

-G^a^atis. 

[0 0 2 6] #^©»2 0©*fllEJ:*lfi. Wfc5*- 
y-fe-SflCft l/tlfx** yfe-S?©#BltS:£$* 

; - FjWttEtff 5 *^ vt-StolfW 8 -* ©* W 
> t> ^agrees, aa©; - FfcE+StWBl^** 
vt"-2?©flBlfe4*t*fe«)CWB^ vfe-S??^ 

[0 0 2 7] *^©H2 1 ©»t»CJ:*itf. WRx- 
^ yfe-SJCftl/CfcT'?:** yfe-y©flBS&£& , t 
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[0 0 2 8] #3l8I©fS2 2©TOC±*Ul WH*- 

S*tSlC J: US*-* £*aS1-6Sfi©7n ^AfctSKi 
tS3>^a-*«^y^III«ii8l«»»T?»oT, ttf 

fe©3- F£, #y - F^mflB^^ y •fc-stol*? 
tfx-#©iz^>h&**re£6, tHR©;-F«:£ 

tSfflBtTx^-^ v-fe-y©«8«:4)W-«fe©C|(nB 
■jivfe-S^>^U-hftSttJt*fcib©3-Kfc«:# 

[0 0 2 9] $^©fl|2 3©ttttlCJ:tlll tfx*^ 

itlKfflKt^BSx- * fc^tS fcfr*-r-* S»' 1 ©S 
fiT*=^^^^U tfflB^^^^atifetrr^f 1 -^ 
yfe-$?x^l/- b©^ 1 ©jWWte*** l © 

fyptz < t % 1 o©^ 2 ©SttAStttU MIBtH 2 ©^ 
h©H2©AftftT*fe5^2©K:7 J ^ vfe-S?©«» 

[0 0 3 0] *^©^2 4 ©aHttcfchtf. \*?*% 
y -fe-ySr-Ktt*^*^ 9-fe-yfiaiS/^-WCfi 
V»T, 'J>!fc<2; : felo©^l©^fi}C, d>&<£%)Bft 

fx?-* y^-V7-yfl>- h<om 1 ©JWeffc-e 
»sii©iff^ v*-s?©«Bfti:**trtffy-^ 9 

yfe~S^>^l/- h^&il>3!fe<fc% l o©S2©iSS 

Stf-yfU- h©«2©J|»ftTf»*ll2©tirfy-^ >y 
■fe-y©«BitS:^tf, JWStftlff^^v-fe-y** 

i [003 1] *IS3g©^ 2 5 ©jftWCMltf. H#-r- 
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[0 0 3 8] J&LfeWW»ftk J-K m 5^ 

##3-tr }cMb"Cjl;tfcv N3tt47# -fe^^nrieT'feo 
to o 3 9] iiTfBWt*^f*^ rfc-yHHl3> 

«A- F9x7fc V7 bi>x7fcffliB»^t)1i*WtK:J: 

&tfr;t;* yiz-yjlMS/^T-A&Sun Microsystems*! 
©Java:/oy5S:/iWfc*BBl/t£Sbfe (JavaJ4 

©#5£© 3> fcTa- * S/^?iOU*3> * "tRX 
BWSZfcEli&bfcK PASCAL7W 

[0 0 4 0] [£§l©gjM] HlAfc*SU/C, * 

tt. "fe yfi/Xf-J* i o o jfivfit* v -fe - s*©** 7" 
^^IfeftftHSWS. z©**^ i o o «:tfr:fr* y 

v^vO;r£fcj3^1"5 : fe>©TH4&<, Hl©^&&$& 

w ^>yfe-yoii^ioon jnamnca. 

j£#t-s>;ii:ft<» tff^jiyiz-y&j&fBtSfei&lc 

Bfiaeay©'j=7 ©hwmk) i*W**-»«a 

[0 0 4 1] SQ©t» IWIICB. fWt^f 
«KU H 1 AfcfWttfc** 1 0 2©#tc* 
10 1 (Wtfcfc ;N-V^3^tra-^) ICg^bT 
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fetCftLMni/tfa.-* 1 0 1 £4 >jt7i-Xt4fe» 
<D4>*-7x.-ZfSJ\- FOx73>jK-*> h&tf/ 
3U4V7 htfx73>jK-*> hflftWcSSJHS/v- 
x73>#-*>K&tf/Xl4y7h9x73>3K-* 
> h fr^tf. 1 0 0 14. fcT-r** v * - 2>S»B 

safBu^f 104 (x&msvyt) *MK$ti. * 

7"S/a>fcUT, ifx^yfe-y&yayc'-X'fX 
# l o 5fcif®, t^©*^ <«*.«. *6S) icjry* 
#t ^&ffis*i-g>^t»Ji 3&©eiittfttcffliitf « z: 

*&. IBtB&DiBftill/Ctt. ffiiCCD-ROM, C 
D-R, CD-RW, DVDfciftf**. *$£&©$t 

#ttflwct«AWufev^i;fty, ^tifeoftfcyicso 

[0 0 4 2] tff*jlV"fe-S^MlB10 0tt. **7" 

3U*rt»ftWfct*fc«>CD* <y iz- i?#5iX7-V ^ i: & 

Vffi&z?4*\i~ yyh9x7T% mM3>tfx-3? 
l 0 l\zmz>vyhV xT77V>r-i'ayt.Lzm 

[0 04 3] 01B&#MbT> dr-vyf-VV*-^ 
10 6t, ^-r^-yv-^ 1 0 9 fc, 
x-f ^ 1 0 7 i:, ilffiv^-^'Y 1 0 8 1 £^1% 
y^^V*-S?V 1 0 614, tfrtf-r-^fc^rVy^-Y 
t SfeftC^^y^^S^Sl 0 2 fcftWPtft. c*x*-r 
— * 1 1 SI*. Jftl!«lici4, *yfe-Sfl»x^ * 1 
0 7/\j^$tl-S>o -jRttC*A«. 3-if 10 354^ 
yfe-yWIxf*^ * l 0 7 Sr^fflbTtfr^^ >yiz- 

igxx-f ^ 1 0 7l4n-9 , ©||#S:^U 

v^-y-v i o 6a«* 1 1 o tafliu (fwan 
fe) BKt^*^ y *- ywscftoTt;*** yfe- 

1 1 1 fctf^y-yu-Y 1 0 9^jiffitS 0 
^•7°U-Y 1 0 9 ©iW^©^ ^ y -fe-yiRtx^-f 
* 1 0 7/\^Xi4f : -^ 1 1 2«Wx*£fc%»»*. 

«Atf. is^fci4, mmmm, 9 4 \* mum 
/jxmmmm easy, -t*#it& 
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*>. a-wit^-TV-^ i o 9 mm 1 2 4 
u yzfitiy/-' v i o 9 ^ e> * y iz - ynstx^-f # 
i o 7/s^^Kfeg'i#i 1 23waytanft. wrote 

-#©*/-*>:*.©*&* U fcifcfcy felftK** 2offil 
jftTf*oT*»AV>. * vfe-S^Bixf J -f #10 71*. 
n-if 1 0 3 (D&m 1 2 1 ©TIC *© 1 ^OWS 

xi«ti6 2o©B#ratefi^©#fS£a--9 i i 0 3 

(4 ) t/-t- vi- &f-T-< yf •• z.<m&. 

* yt-ifffi&x-'rJ # 1 0 7 tt, a-tf©«? ( 1 2 
l) ©%i:lc («*.«. a-W (3) r^jy-*** 

rv^^fc^y y^L/fett) * ^©wratettfr 

i) . Tgfc, fcrfs*^u-Yio9tttr7^t^yfe-y 
d2 5) . zLjucfcy, trx^i^- 

■Yfi, a-if 1 0 3mMt&£*mbX^Z>tJib& 

jfix^-f * 1 0 7/\j£fg£;ftS (112). Iv^n-V 
# 1 0 7tt£©WKfe*BBl/t, St^SftT 

(fifllfeffiSt*-^*^** (12 6) . 

(5) I^**y1z-2»:;lv1z-5fl^^* 
1 0 7tt. a-if©«?l 2 l©TiC ^y©^* 
3lyfe-J?lSttfc*fPU £©M58©WffifcKKAH' , C 

;n 2 2fr6«S#©XI*ftCfft*a*i , Cv^if5 s **y 
■fe-y«5tl 3 5&|g*^lSii:^T*t, *©*3Bl 3 
5fcfl&fr©IOi*d»*.!M*C» ^^-fe-i^Sgx^ 
#10 7 titf^** **-5«S 1 3 4 fctrr** -yfe 
-VWM-yr^JVi 2 2tc-fe-yu tW^l'-^ l 

0 9ttX©77>f/l>fc7**:vr4Zl:#TJiS<&. 

t% a-ifi.os^if^jr^-YioofeftmbTtr 

1 o stf^fc*^* vt-yiW***^^* 

tvt-iffitktt * 1 o 7tt. !&&©*<? 

■^^y>y«:B»ftt«&»^ 

l o 6Affi*i l 0&&fit5. HfflWCtt. a-if l 

0 3©Sf^C«fc-oT^-V^f-vy^#*^7'tSil, * 
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*r?*w*-Vi l o 6 vfe-y*»x5V # l 
o 7^#^3 ^yWRftaMIU * -viz-^Jtx^ 

# i o i\t*v7?v2fttcV7 : *7 : -$<DMm.m. 
m&^j # 1 o T&mvxttw 

(6) Xtttvt-Vmmtf : MttC *yiz-S? 
flKfixf^ # 1 0 7 ft, a— if ©fflfli 1 2 1 ©TK, \£ 

vfe-S*f$i#©/ - F©9^fcWtt*taR 

(7) if?*j*y^s^:31f|v*-s?*i0 8 
tt, n— ifl 0 3©fMl 2 7 ©TIC ^f-v^f-^v* 

-*?■* i o e^feSMtanfe*^^***^? 8 *? 8 - 

#12 9 %MibX^2>¥T* : r-977'<Jll 2 8fr 
[0 0 5 3] IfiftlTf I/— V 1 0 9 SfcT^t-r-^ 77 

•f;n 2 8^5)^^ >yfe-i ? ©tff : ^f : -#a5^1 

3 3 fe«ifflu ssst^e^*^ vfe-y i s o &a 

-if-f>#7x-xi 2 0Ni«tS. *-?i/ay£L 
bt, ^7°^ l o 8*»&a— y>f y*y 

x-7x 1 2 0/s^r^x-# 1 3 1 ZmV&tZttfT* 

»;t-S«|if-l #10 7 &/N-5) Iff**^^ 
^y^yKjDAT, a-lfl0 3H ^J/a>i:b 
T, ^©trx^^^^^mcSMbfc^T'^ 
^•©^Y^^y>#*S:l8a<t-Bfe©lc, ^-f=f-^ 
%-W 1 0 9/\dr^'7°^^fi^l 3 2 Sriiyffi-rziil 
*Tf*S. ^ Vt-*lf^ #10 7 
Z®£o&V7*'r-9<nWgi*rV'7^Vy>flZ. ffl 
^.«tfx5fr-#&ltSlCdr^7 p ^^U «MU &© 

[0 0 54] HlDMHHl/C, HlC©^vfe-S?*» 

iif-/ # «e y a -;n o 7 ©w^H&^-t. * y 

■fe-S^ftx^-f #10 7 (Ctff 1 ^^ yt-ifffi&ftU 
-Ka*lTVMSsWtQ»R«13 8*>&, a-ifl0 3A^ 

3 rXDlrtK a >© e> *> 1 o &3gH-f 6 3 h^T'SSo 
3BRRllB&3o©*^S/a>tt. a) gE#© (tfeb 
$fe^c#^4^Tv^fe) tfT^^y-fe-J^lia&BK 

d4o) , b) £©$;re&oT% (ji?as<fc%a*a 

s) , mzte&ttyt-ymmwmtz (14 
1) , *v^ttc) ryzfu- hfrzmsffikzft&tz 
(14 2) (z.<D1r7t/a >fcov\Tl4, OTfc*l§05 

©»5©iaBK»ci«tbTBiiirr*) ©3^X'fes„ 
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©bwww mm - 

[oo64] *y*-pzmi>r^z®fcm 

tC&fi£l 0 3{C^^X&^5HWT% t^t* 
$>I©y-K£©*ffS«, **"f**Vy>ftt 

[o o 6 5] * yK-mMtv?** -v^-vtvm 
mvom «-^>3» tbx, m##io3ti, 

v'-fc-5*t»© h^y f - fcCi£5%r©BWK>8'H y b# 
?|£>*i.g>Z.iiU:fc£. Z*ife2o©:£^©iffi##;b-tt& 

V y?\zii y, 3.-9* l o 3 litfrtf* y -fe-yfcasi 
y ■fe-2*«i© t fn*>' - KSrfWtS 

ic, *h&©y-K©H*>*5'W/ (x^h^^x 

J - YW£?** yfe-S*P ©ttfcffl'K'f > hXtti'- 
McfcttaXtt*©^-^*©**-^* 1 ^"^ 

[0066] 3.-vmmx%z>m'ftz& ±m>^ 

^©^©ffiSXttJ/-^ «BSRt*feft©*R 

#j y vx&bmm ^ k &tm©ft ^©^©fc^ 

*ffl^tt^-*:>*©ffi5%©ttB 
[0 0 6 7] \£&t*'**-99*V*9B-> 

y±-v<mm i o 3 a^t^r*;* vk-pmt> 
v-^-i/ayxxmmz) zmtzsmsM 

<tr7 : ^ y iz-^tr^-x-f y y-fe- 
S^j-tfF-f^ >ytc«k i o 3 litfxtf* y 

■fc-JJIGtfcttlBl/T. tff^*y"fe-S>©*4ffi*K: 
*a-ft«t*i4:3W** trf^yiz- 

y*a© i o©y - f&# y y ?t43ixj: y, * y 

[0 0 6 8] i-W-i/ayfr n-iftibf-r*^ yfe 
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©»34jayy-*a4oi oaiiwj-) *a%t 

-mta o 3 -c^^y y - mwttz z.tmmx& 
4. 

[0 0 6 9] ^x^©J|&teg{CKbT3.-if 

{c*fLT7^ - F>*y fcft*c, fcfx** yfe- 
#>!r**-<f;i/ffl r;^>KjK-^j t5tt*£fclcJ:»K 

[0 0 7 0] ®c, ifsM^-fe-SWISl/Cvt** 

7*:t^©ttj©C^t43£^tgT'&4^ rtilix 

x#©&JfcaWCSfeT** 78/ a >ffl»T33WVC %& 

[0 0 7 1] tf^^y-fe— Mfy-S/a^ttlff 8 *^ 
3 ylZ-jXOSf&fit 1 0 3 tCMbTflJffinrtliitS £ £ 
T*£4,, 

<tfr t 5f ^ yiz-i>1S*7niz*©m> 
@NW$8) * 7 s ** y * - S?«D«|CD«»©V ^ < ofr t: 

[0 0 7 2] ASnSHCtt. bfx^^SSttloT'S) 
5. 

[0 0 7 3] ^[KjlCli, ^-CD^x-fTXhy-A^ 

[0074] «g*i^ naawctt^^^y^ytH 

[0 0 7 5] tTx*^ ylz-Sfli#<©$£tCj£«HltB 
3^ ^r^-^ yfe- s?©WWa*aBSKiB<BWc 

)SCT^f3tv5o tot, JgAli**©Ei*T*©^^ 
10 *T*ttfc<, ^©a»©*»&KftT»*^*Tfft 
5= 

[0 0 7 6] ^ElC^LT«t)tl5^KaS/M5SlCil 

[0 0 7 7] B»WH^K||[y±tf6*V&fW©ffiSJtT» 
*AWfejiy*-$?©ffi«**y. WWsiJ©* 

ft. .«!Tll»!i!7U-Ari:©Wli:ttlW!»J» jKS 
5= 

50 [0 0 7 8] «(l^n-fe^tC-3V^*P5»*Wll&5l» 



(25) 



000-232635 
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48 



*xhxa*©MM (M^a mm) &mt 

5Mr-f>^ 7^->3>, 10 
[0 0 8 7] a-UK*5*v-fe-5>«H^tfW*' ft 

[0088] m.m®*$ i-iombL 

(N*J£ f < H f - any x59fe » ** 7" fc- 
>*7*Va- **7*fo- K9H-J ) &-^«>5J:y*>» SSliJ: 

tt. a--iflafcy#*A»c*fl/t. jyYu99*/ay 

[0 0 8 9] ±&®«Stt. **fc»X\ 

* ylz-S?©)W©J^:3U**©#© 1 o(753i<-f > HXtt 
*©-$ (Witt. lo«DjaRtt*©*©-»Xl*l 



ffijes nr.v ^m^ffifitz kmz$m a *vt % a 

K Be, yiz-i^mft&fJELTlS 

[0090] im<D$mmi hi 2 amwbi/t, 

&, SMUJ/^A 1 2 0 0 tftfr;t;* y -fe-S?®** 

tfc&fc, :* y -fe-JWx^-f # mmz*b<»~e& 

5. SISI^^t-A 1 2 0 Ottl*? 8 ** V*-J?CD56fll 
[009 1] gffift 1 200 ©ft*»fctefrtt.- «£*© 

y-7 gHBtf® t^** <v iz - v<D%.mit%m l 
#we>tis htr«y ^©^gt±«fefw>y ^Ttr^^ y -fe 

-^©^atiTVNSXli**©#7iX}iW^lc^1- 

.«ffljWf*u^ 3© h try ^©Tji*^*©^^ 

[0 0 9 2] 01 2 AKjSt*»KMtt. J«S!flWctt* 
— r 1/--V fcBWI-* bfx^^V-^ 1 2 0 2 i: 

r*ie>B«K:f«fiflwaaii 2 0 i©tptc^a 
tixv^o zcDtmftmmm^yvo.-* 1 2 0 

(i, z:© (H2©) |»micBGib'CRH9tsmi«: 

* e> icisitatife*^exttM*ji*asT* 

*ifc^-5y->lyS-y*SSt*fcttC. til© 03=58 

tf/Xtt#~f 4 *^i^rWrtt Sffi^i 200 

^»^i:iBi^tc, «©*^ m«. ssd tcfcy 

gft#^&IVB^*, 7U*jM— ?4 7sV 1 2 0 5© 
iciy, *yj/a bfr^yfe-S?©ja<ffiSSS 

&«fflUT%>sv\ *©*§&, sffi#i*tiKg*©ia« 

y -fe - S?*«* y h V- * feg#a tifcA 11 © «fc $ K 
y t-S?S^Slt*ittBlV^ S#JS 1 2 0 0 & 



(27) 

51 

[oioo] Jgic, Xtttvt-yZB&WZt 
tic &*%<ffi&stMK3&&t6 ) - F©9^n/t 

£T#^©tt£iCS^tS3£#T'£S. 3*U1 M 

y, a— tfii, if^^yfe-^©^-^^^'^ 
tS, \£T t ^*j^-V^>(Di/- f ry^i'*jt-V^ 

XHS!l©7:/y<!r-f s >ic«k y^BS*!***^-* 
^Xttff*^ yfe-S?*»6JR»J ffltft^CDBWe. ^ 

[0 10 1] Iff^vt-^fflSSSIH^fc^tW 

[0102] ^^y-fe-ya*!*. ^vfe-yft* 

xmx>%fefgi 1200 icw*>s tr?*** » *- s^at 

[0103] rai3 ommmi m 1 3 ak, 
h# 2 (ommmz. v *- s^acw*^ 
bfc%©T*fes. but. wsojaBHit^f^^y* 

-SSWtS/*^* 1 3 0 0 i^e>. t*uw<t sfc 

fetC, 01 3 Ail 35/lia-**vM7-*130 1 
£:ftbTg«S 1 2 0 0 |c£|jfct£3M 1 0 0 fa** 
jW. #y h9-# 1 3 0 1 iC»ok*4V&ft>© Wj 

(tfcfe'b, S9waarjf/X(*SM») BSSfiEioo 

gflMSi 2 o 0©m*lc^fStsr®fiMI«:^fJt 

-y*jaMIX»456«t*i:*C. SfcEjaMWioOXtt 
9Mi 2 o ocBBtb"C«Wbfc3E^te*y*-y* 
jft^t5«*S#ts©*W*bvv tot. *m® 

immf®c&^xi± mukmzommmfr 
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- yflBftx^-f * ©t£fr iftWcBBtifT 8 *^ y * - 2? 
[0104] \£fit% yfc-ySHBia^A 1300 

ttCffiMSftfttf&K VP** vM-VmMzk y, 
1 2 0 01: bT* v -fe-J?fc«|lt*«*ft*t 

*yte-5«at:«8l/C, ^T^yiZ-i^jIbT 
bt, t^rtf ;* y-fe-MWBJ/^A 1 3 0 

oil insure, u-t (##&§{&) ^a-^y-fe-y 

fSUXf- a 1 2 o o a, ftiesi i xr«6 2 ammimz 
mMLxmmbt=.^olz, 3>£:i-**yh'7-*l 

3 o i icgssrrssfBm o o&t>vxi±§Mi 2 0 

[0 10 5] $oT, (03©) 

a. y-7 ^Nffififtd trx#*?-fe-j?cin£T, m 
t*tv^«*wfc*. ffiw.w<r*mm& y-7 
ft*JST*fes©*w*bv\ b^u ifg^r^yfe-s? 

t*ii#Xtt*©H»»«:y-7 ^f**^ 

<, «itaaw7Fi/^ 3.-7* 

-AUV-XD>r-* (url) ) zmMLX : b&<. 

7 ©^6&ffc) ^^yfe-y&BKttstrx^y 
*-j^ftff*flcaiBt6Si:K:J:yflaw) (■«! 
fc*>, #^?ift) U -7 kfx;** y -fe - ^j^i/^x^ 

fcafflre***ic. tr^^ -7 

b**U >y -fe - y il fcfx^^ y -fe- il S: 

^Hf^CiB»^*yeT (OT, rfg^fc-Brlfx^^y 

•fe-yj t^o) «:«fflu ^^v-fe-sawss/^ 
mx%z>, 

[0 10 6] ^©trx^yiZ-yaffi^-rAl 3 0 
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f^y-iz-i? Qktf/ntttttv^-Vffig) ft 
jlo!W©J:5C *rfe-s;ftW®a-lf (SfB 

[0114] im^^m msvmtmmi-L >p 
&< i ^©«»^s*iTv**«tt4. #8$®f§ 
i ®&»gML * 2 ®#im» ts 3 <»mmi&m% 

t^;^yiz-^x>7l/-h®=Rftfl:) MM* 

mm^y-fi;- h mmttx. yu-s?® 

ffr&f jb^ftJS I/O n£® i: if l5«fc-2> * tf-r*^ f -fe 

Xbfx** y -fe-y*8itfe4JiW*£i:C* »J, mm 
I5*y*-S?ft*fll OBWD Lfc#&» 
■&fottT>iy*-yft***T4^*Zfc*^**. 

mm ® rji3w*i:7'f-y>yj jwrauvcv**** 

[0 115] *v^tt. a^bTa-**? M7-*©tf- 
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z»yy-*n4r-*URL) ft#t*»ift®KlltBWfc 

KfiDilg^ &3MBt * 3 1 \Z\$& 6 &K 
[0 116] JSSfifttCli, n^tfa-^J/^x^if© 

I/- h ft*® J: e> fCJg^T'^S. 
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1 . Title of Invention 

A Method and System for Conveying Video Messages 

2 . Claims 

1. A method of conveying a video message comprising the steps of: 

(i) capturing video data comprising at least image data and associated audio 

data; 

(ii) creating a video message structure; 

(iii) establishing a link between said structure aod the video data to create a 
structured video message, said structured video message being chaiacterized by a video 
message structure that provides an originator, of the me'vsage, enhanced manipulation 
capabilities for the video data by manipulating said structure; aud 

(iv) conveying the structured video message to a recipient for viewing aud/or 
Cor providing said recipient substantially the same enhanced manipulation capabilities. 

2. A method according to claim 1, wherein said video message structure is a 
hierarchical structure having a plurality of nodes. 

3. A method according to chum 2 ? wherein establishing a link between said structure 
and the video data includes associating at bast one node with at least one segment of 
video data to provide at least, one linked node. 

4. A method according to claim 3, wherein establishing a link includes associating 
with each linked node a start time position and end time position off the video segment. 

5. A method according to claim 3, wherein establishing a link includes associating a 
start time position and an end image data of the segment oE video data with said node. 

6. A method according to claim 1, wherein linking between said structure and said 
video data is performed during capture of the video data. 

7. A method according to claim 1, wherein the enhanced manipulation capabilities 
includes one or more capabilities selected from a sef consisting of: 
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Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 

S. A method according to claim l t wherein step (ii) includes the further sub~steps of: 
providing a message template; and 

executing said message template to generate said video message structure having a 
plurality of nodes, each said node being capable of representing a segment of video data 
of said video message. 

9. A method according to claim 8, wherein said structured video message is an 
instantiation of the message template. 

10. A method according to claim 9, wherein said instantiation of the message template 
provides a customised video message structure according to predetermined user 
preferences. 

11. A method according to claim 10, wherein said customized message template can 
be saved as a new message template including the user preferences. 

12. A method according to daim 1G> wherein during execution said message template 
provides guidance to a user generating the video message structure 

13. A method according to ciaim 12, wherein the template prompts a user for user 
input information. 

14. A method according to claim 8, wherein the message template further sets 
attributes for the video message. 

15. A method according to claim 14 , wherein the attributes include any one or more 
selected from a set consisting of: 

- a tone of the video message. 
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* an intent of the video message; 

duration of the video message or part thereof. 

16. A method according to claim 8, wherein conveying said structuiccl video message 
Includes transmitting over a. network said structured video message. 

17. A method! according to claim 16 y wherein said structured video message includes 
said video data and said message template. 

18. A method according lo claim 17, wherein transmitting said message template 
includes transmitting a reference address location for obtaining the message template. 

19. A method according to claim 17 7 wherein transmitting said video data aiid said 
message template includes transmitting a reference address Location for obtaining the 
video data and message template respectively, 

20. A method according to claim 2, including the further step of editing said 
structured video message. 

21. A method according to claim 20, wherein said editing includes the further sub- 
steps of: 

storing said video message in a memory; 
displaying said video message structure; and 

manipulating said nodes to place said video message in a desired format, wherein 
at Least one node represents a segment of said video message. 

72. A method according to claim 20, wherein additional nodes representing farther 
captured video are added to said video message. 

23. A method according to claim 22, wherein any unwanted nodes are deleted from 
said structure so that only wanted information in retained. 

24 . A method accoiding to claim 23, wherein a segment of said video message that is 
represented by a deleted node is retained m said memory. 
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25. A method according lo claim 1, wherein said video message structure allows said 
originator to include at least one of a plurality of standard items in said video message, 

26 > A method according to claim 25 1 wheiein said standard items include at least 
standard greetings, a business address and a company profile. 

27, A method according to claim 2, wherein each node is labelled by a textual string. 

28, A method according to claim 27 7 wherein said textual string relates to the content 
of said video segment. 

29, A method according to claim 27, wherein said textual string is able to be edited. 

30, A method according to claim 1, whereiu baid originator or a iccipient of said video 
message can pause and restarl said video message when viewing said video message, 

31, A method according to claim 1 ? wbereiu said video message structure indicates a 
current position within said video message when viewed, 

32, A method according to claim 31, wherein said current position is indicated by a 
kacaoke-style ball displayed within said video message structure. 

33, A method according to claim 32, wherein said current position is indicated by 
highlighting current text within said video message structure. 

34, A method according to claim 32, wherein said current position is indicated by 
displaying corresponding text of any video sequence at the base of a display upon 
winch said video message is being viewed, 

35, An apparatus for conveying a video message, said apparatus comprising: 
capturing means for capturing video data comprising at least image data and 

associated audio data; 

processing means for creating a video message structure and establishing a link 
between said structure and the video data to create a st-ructured video message, said 
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structured video message bcfrtg character!?^ by a video message stiucture that provides 
an originator, of the message, enhanced manipulation capabilities for the video data by 
manipulating said structure; and 

means for conveying the structured video message to a recipient for viewing 
and/or for providing said recipient substantially the same enhanced manipulation 
capabilities, 

36. An apparatus according to claim 35, wherein said video message structure is a 
hierarchical structure having a plurality of nodes. 

37. An apparatus according to claim 36, wherein establishing a link between said 
structure and the video data includes associating at feast one node with at least one 
segment of video data to provide at Jeast one linked node, 

38. An apjteiatus according to claim 37, wherein establishing a link includes 
associating with each linked node a start time position and end time position of the video 
segment. 

39. An apparatus according to claim 37, wherein establishing a link includes 
associating a start time position sawl an end image data of the segment of video data with 
said node, 

40. An apparatus according to claim 35, wherein linking between said structure and 
said video data is performed during capture of the video data. 

41. An apparatus according to claim 35, whereio the enhanced manipulation 
capabilities includes one or more capabilities selected from a set consisting of : 

Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 
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42. An apparatus according to claim 35, said apparatus further comprising; 
means for providing a message template; and 

means for executing said message template to generate said video message 
structure having a plurality of nodes, each said node being capable of representing to a 
segment of video data of said video message. 

43. An apparatus according to claim 42, wherein said structured video message h an 
instantiation of the message template, 

44. An apparatus according to daim 43, wherein said instantiation oi the message 
template provides a customized video message structure according to predetermined 
user preferences* 

45. An apparatus according to claim 44* wherein said customized message template 
can be saved as a aew message template including the user preferences. 

46. Aii apparatus according to claim 44, wherein during execution said message 
template provides guidance to a user generating the video message structure 

47. An apparatus according to claim 46, wherein the template prompts a user for user 
input information 

48. An apparatus according to claim 42, wherein the message template further sets 
attributes for the video message, 

49. An apparatus according to claim 48, wherein the attributes include airy one or 
more selected from a set consisting oi: 

* a tone of the video message, 

* an intent of the video message; 
duration of the video message or part theieof. 

50. An apparatus according to claim 42, wherein conveying said structured video 
message includes transmitting over a network said structured video message. 
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51. An apparatus according to claim SO, wherein said structured video message 
includes said video data and said message template. 

52. An apparatus according to claim 51, wherein transmitting said message template 
includes transmitting a reference address location for obtaining the message template. 

S3* An apparatus according to claim 51, wherein transmitting said video data and said 
message template includes transmitting a reference address local ion for obtaining the 
video data and message template respectively. 

54. An apparatus according to claim 36, said apparatus further comprising editing 
means for editing said structured video message. 

55. An apparatus according to claim 54„ said editing means comprising; 
storage meaj&s for storing said video message in a memory; 
display for displaying said video message structure; and 

processor for manipulating said nodes to place said video message m a desired 
format, wherein at least one node represents a segment of said video message. 

56. Ail apparatus according to claim 54, wherein additional nodes representing further 
captured video aie added to said video message, 

57. An apparatus according to claim 56, wherein any unwanted nodes are deleted 
from said structure so that only wanted information in retained, 

58. An apparatus according to claim 57, wherein a segment of said video message that 
is represented by a deleted node is retained in said memory, 

59. An apparatus according tu clajm 35 , wheieia said video message structure allows 
said originator to include at least one of a plurality of standard items in said video 
message. 

60. An apparatus according io claim $9> wherein said standard stems include at least 
standard greetings, a business address and a company profile. 
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61. An apparatus according to claim 36, wherein ew*ch node is labelled by a textual 
string. 

62. An apparatus according to claim 61, wherein said textual suing relates to the 
content of said video segment. 

63. An apparatus according to claim 61, wherein said textual string is able to be edited, 

64. An apparatus according to claim 35 s wherein said originator or a recipient of said 
video message can pause and restart said video message when viewing said video 
message, 

65. Ait apparatus according to claim 35, wherein said video message structure 
indicates a current position within said video message when viewed, 

66. An apparatus according to claim 65, wherein said current position is indicated by 
a karaolce-styte hall displayed within said video message structure, 

67. An apparatus according to claim 66, wfaciein, said cuuen! position is indicated by 
highlighting current text within said video message structure. 

68. An apparatus according to claim 66, wherein said current position is indicated by 
displaying corresponding text of any video sequence at the base of a display upon which 
satd video message is being viewed, 

69. A computer readable memory medium for storing a pro£ram for apparatus which 
processes data, said processing comprising a method of conveying a video message, said 
program comprising: 

code for capturing video data comprising at least image data and associated audio 

data- 
code for creating a video message structure; 

code for establishing a link between said structure and the video data to create a 
structured video message, said slnietured video message being characterized by a video 
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message structure that provides an originates , of the message, enhanced manipulation 
capabilities for the video data by manipulating said structure; and 

code for conveying the structured video message to a recipient for viewing and/or 
for providing said recipient substantialt^ (he same enhanced manipulation capabilities. 

70. Tiie computer readable memory medium according to claim 69, wherein said 
video message structure is a irierarchical structure having a plural) Ly of nodes. 

71, The computer readable memory medium according tc claim 70 > wherein said code 
for establishing a link between said structure and the video data includes code for 
associating at least one node with at least one segment of video data to provide at least 
one linked node. 

72, The computer readable memory medium accordhig to claim 71„ wheiem said code 
Tor establishing a link includes code tor associating with each linked node a start time 
position and end time position of the video segment. 

73, The computer readable memory medium according to claim 71, wherein said code 
for establishing a link includes code for associating a start time position and an end Image 
data of the segment of video data with said node. 

74. The computer readable memory medium according to claim 69, wherein linking 
between said structure and said video data is performed during capture of the video data. 

75. The computer readable memory medium according to claim 69, wherein the 
eakauced manipulation capabilities includes one or more capabilities selected from a set 
consisting of: 

Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 
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76, The computer readable memory medium according to claim 69, wherein wherein 
code Jbr creating a video message structure further includes: 

code for providing a messes template; and 

code for executing said message template to generaje said video message structure 
having a plurality of nodes, each said node being capable of representing to a segment of 
video data of said video message. 

77. The computer readable memory medium according to claim 76, wherein said 
structured video message is an instantiation of the message template* 

7S. The computer readable memory medium according to claim 77, wherein said 
instantiation of the message template provides a customized video message structure 
according to predetermined user preferences. 

79, The computer readable memory medium according to claim Y8, wherein said 
customized message template can be saved as a new message template including the user 
preferences. 

80, The computer readable memojy medium according to claim 18, wherein during 
execution said message template provides guidance to a user generating the video 
message structure 

81. The computer readable memory medium according to claim 80, wherein the 
template prompts a user for user input information. 

82. The computer readable memory medium according to claim 76, wherein the 
message template further sets attributes tor the video message, 

S3. The computer readable memory medium according to claim 82 y wherein the 
attributes include any one or moie selected from a set consisting of: 

• a tone of tbe video message, 

* an intent of the video message; 
duration of the video message or part Lheieof. 
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84. The computer readable memory medium according to claim 76, where in 
conveying &aid structured video message includes transmitting over a network said 
structured video message. 

85. The computer readable memory medium according to claim 84 7 wherein said 
structured video message includes said video data «nd said message template. 

86. The computer readable memory medium according to claim 85, wherein 
transmitting said message template includes transmitting a reference address location for 
obtaining the message template, 

87. The computer readable memory medium according to claim S5 7 wherein code for 
transmitting said video data and said message template further includes code for 
transmitting a reference address location for obtaining the videu data and message 
template tespectively. 

88. The computer readable memory medium accordiug to claim 70, further including 
code for editing said structured video message. 

89. The computer readable memory medium according to claim 88, wherein said code 
for editing further includes: 

code for storing said video message in a memory; 
code for displaying said video message structure; and 

code for manipulating said nodes to place said video message in. a desired format, 
wherein at least one node represents a segment of Said video message, 

90. The computer readable memory medium accordiug to claim 88, wherein 
additional nodes representing further captured video are added to said video message. 

9L The computer readable memory medium according to claim 90, wherein any 
unwanted nodes are deleted from said structure so that only wanted information En 
retained. 
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92+ The computer readable memory medium accordiug to claim 9t t wherein a 
segment of said video message that is represented by a deleted node is retained in Said 
memory, 

93. The computer readable memory medium accordiug to claim 69> wherein said 
video message structure allows said originator to include at least one ot s a plurality of 
standard items in said video message, 

94. The computer readable memory medium according to claim 93, wherein said 
standard items include at least standard greetings, a business address and a company 
piofile. 

95. The computer readable memory medium according to claim 70* wherein eacli 
node h labelled by a textual string. 

96. The computer readable memory medium according to claim 95, wherein said 
textual stxmg relates to the content of said video segment. 

97. The computer readable memory medium according to claim 95 v wherein said 
textual string is able to be edited. 

98. The computer readable memory medium according to claim 69., wherein said 
originator or a recipient of said video message can pause and restart said video message 
when viewing said video message, 

99. The computer readable memory medium according to claim 69 t wherein said 
video message structure indicates a current position within said video message when 
viewed. 

100. The computer readable memory medium according to claim 99, wherein said 
current position is indicated by a karaoke-style ball displayed within said video message 
structure. 
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101. 'One computer readable memory medium according to claim 100, wherein said 
current position is indicated by highlighting current text wjtbin Said video message 
structure. 

102. The computer readable memory medium according to claim 100, wherein said 
current position is indicated by displaying corresponding text of any video sequence at the 
base of a display upon whieh said video message is being viewed. 

] 03. A method of creating a video message comprising the steps of; 

providing a video message structure including at least one node; 

providing video data, said video data comprising at least image data and 
associated audio data; 

associating at least one node of the video message structure with at least one 
segment of the video data to provide an associated structure; and 

utilising the associated structure to provided enhanced manipulation capabilities 
of the video data to create a siructm ed video message* 

104. A method according to claim 103> wherein the enhanced manipulation capabilities 
includes one or more capabilities selected from a set consisting of; 

Video message planujng; 
Video message capturing; 
Video message labeling; 
Video message navi gating; 
Video message editing; and 
Video message annotating. 

105. A method according to claim 103, wherein the video message structure is 
represented by a hierarchical tree structure having a plurality of nodes. 

106. A method according to claim 105, wherein each node is labelled by a textual 
string. 

107. A method according 10 claim 103 7 wherein said structured video message Js an 
instantiation of a video message template. 
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108. A method of creating a video message comprising the steps of; 
creating a video message structure including at least one node; 

capturing video data, said video data comprising at least image data and audio 

data; 

Unking at least one node of the video message structure with at least one segment 
of the video data to provide an associated structure; 

storing the video data and the video message structure; and 

utilizing the associated structure to provide enhanced manipulation capabilities of 
the video data to create a structured video message. 

109. A method according to claim 108, wherein the enhanced manipulation capabilities 
includes one or more capabilities selected from a set consisting of: 

Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 

I I, 0. A method according to claim 10&, wherein linking includes associating with each 
linked node a start lime position and end lime position of the video segment. 

III. A method aecoidbig to claim 108, wherein the video message structure is 
represented by a hierarchical tree structure having a plurality of nodes. 

112. A method according to claim 11L, wherein each node is labelled by a textual 
string. 

113. A method according to claim 108, wherein said structured video message is an 
instantiation of a video message template, 

114. An apparatus Tor creating a video message comprising; 

means for creating a video message structure including at least one node; 
means for capturing video data, said video data comprising at least image data and 
audio data- 
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means for linking at least one node of the video message structure with at least 

one segment of the video data to provide an associated structure; 

means fot storing the video data and the video message strucJure; 3nd 

means for utilizing the associated structure to provide enhanced manipulation 

capabilities of the video data to create a structured video message, 

115. An apparatus according to claim 114, wherein me apparatus further includes a video 
play back device and. video display for viewing the video message , 

116. An apparatus according any one of claim I14 T wherein the enhanced manipulation 
capabilities includes one or more capabilities selected from a set consisting of: 

Video message planning: 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 

117. An apparatus according to any one of claims 114 t whciein said structured video 
message is an instantiation of a video message template. 

11.8. An apparatus for creating a video message comprising; 

a video camera aiid capture manager for capturtag video data, said video data 
comprising at least image data aad audio data; 

a message structure editor for creating a video message structure and for 
associating the video message structure with at least one segment of the video data to 
provide an associated structure; 

a storage device for storing said video data and the video message structure; and 
manipulation means for using the associated structure to provide enhanced 
manipulation capabilities of the video data to create a structured video message. 

119. An apparatus according to claim US, wherein the manipulation means includes 
the message structure editoi configured to provide one of a plurality of edit modes and a 
user input/output interface. 
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120. An apparatus according to claim 118, wherein the apparatus further includes a 
video play back device and video dispby for viewing the video message . 

121. An apparatus according to claim 118, wherein the enhanced manipulation 
capabilities includes one or more capabilities selected from a set consisting of; 

Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
Video message annotating, 

122. An apparatus according to claim 118, wherein said structured video message is an 
instantiation of a video message template. 

123. A computer readable memory medium tor storing a program for apparatus which 
processes data, said processing comprising a method of creating a video message said 
program comprising: 

code for creating a video message structure including at least one node; 
code for aiptuiiog video data, said video data comprising at least image data and 
audio data; 

code for linking at least one node of the video message structure with at least one 

segment of the video data to provide an associated structure; 

code for storing the video data and the video message structure; and 

code fur utilizing the associated structure to provided enhanced manipulation 

capabilities of the video data to create a structured video message. 

124. A compute readable medium according to claim 123, wherein the enhanced 
manipulation capabilities includes one or more capabilities selected from a set consisting 
of: 

Video message planning; 
Video message capturing; 
Video message labeling; 
Video message navigating; 
Video message editing; and 
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Video message annotating. 

125. A computer readable medium accord ing lo claim 123, wherein the computer 
readable medium includes any one or more media selecred from a sel consisting of: 
Compact Disk -Read Only Memory (CD-ROM); 

Hard Disk; 
Floppy Disk; 

One or More Servers on a Computer Network; and 
Flash Memory Card(s). 

126. A method of conveying a video message comprising the steps of; 
providing video data comprising at least image data and associated audio data; 
providing a video message structure; 

estabtishing a Link between said sJruclurc and the video data to provide a 
structured video message, said structured video message being characterized by a video 
message structure that provides an originator, of the message, enhanced manipulation 
capabilities for the video data by manipuktfing said structure; and 

conveying the structured video message to a recipient for viewing and/or for 
providing said recipient substantially the same enhanced manipulation capabilities- 

127. A method according to claim 126, wherein said video message structure is a 
hierarchical structure having a plurality of nodes. 

1.28. A method according to claim 127, wherein establishing a link between said 
structure and the video data includes associating at least caie rtode with at least one 
segment of video data, 

129. A method according to claim 128, wherein al least one node is labelled with a 
semantic label describing the topic of an associated video segment, 

130, A method according to claim 126, wherein the enhanced manipulation capabilities 
includes one or more capabilities selected from a set consisting of: 

Video message labeling; 
Video message navigating; 
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Video message editing; and 
Video message annotating. 



131. A method according to claim 126, wherein conveying said structured video 
message includes conveying the video data and separately the associated video message 
structure. 



132, A method according to claim 127, wherein conveying said structured video 
message includes conveying the video daia and a reference address for locating the 
associated video message structure. 

133, A method according to claim 128, wherein conveying includes transmitting over a 
network said structured video message, 

134, A method of conveying a video message over a network* wherein said video 
message includes at least a video image and an associated audio message, said method 
including the steps of: 

capturing said video message on a first apparatus ; 

processing said capttucd video message lo provide a structured video message, 
wherein said structure video message is represented as a structure to allow originator 
labelling* navigation, editing and annotation capabilities: and 

transmitting over said network the structured video message to at least one second 
apparatus; 

receiving said structured video message at the at least one second apparatus; 
processing and viewing said received structured video message by a recipient in. 
accordance with said structure. 



135. A method according to claim 134, wherein said structure further allows the 
recipient labelling, navigation, editing and annotation capabilities, 

136, A method according to claim 134, wherein said structure includes a plurality of 
nodes arranged hi a hierarchical manner. 
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137. A method according lo claim 136, wherein said structure includes at least one 
node (linked) associated with a segment of the video- message. 

138. A method according to claim 137, wherein at least one node is labelled with a 
semantic label relating to the segment of the video message . 

139. A method according, to ciaim 134, wherein said structure allows the originator Co 
include at ka$t one of a plurality of standard items in said structured video message, 

140. A method according to claims 139, wherein said standard items arc selected from 
a set consisting of: 

standard greetings; 

a business address; 

a company profile; 

a uniform resource locator (URL); 

date, time; 

originator signature. 

141. A method according to claim 134, wherein said structured video message is an 
instantiation of a video message template. 

142. A system for conveying a video message, wherein said video message includes at 
least a video image and an associated audio message, said system including: 

at least one first apparatus including: 

capturing means foi capturing said video message; 

processing means for processing the captured video message to provide a 
structured video message, wherein said structured video message is represented as a 
structure thai allows originator labelling* navigation, editing and annotation capabilities; 
and 

means for transmitting tire structured video message to at least one second 
apparatus; 

said second apparatus including: 
means for receiving said structured video message; 
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means for processing and viewing by a recipient said received structured video 
message in accordance with said structure. 



143. A system according to daiin 142, wherein said structure further allows the 
recipient labelling, navigation* editing and annotation capabilities. 

144. A system according to claim 142 ? wherein said structure includes a plurality of 
nodes arranged in a hierarchical manner. 

145. A system according to claim 144, wherein said structure includes at least one node 
(linked) associated with a segment of the video message. 

146. A system according to claim 145, wherein at least one node is labelled with a 
semantic label relating to the segment of tfee video message . 

147. A system according to claim 142* wherein said structure allows the originator to 
include at least one of a plurality of standard items in said structured video message, 

148. A system according to claims 147, wherein said standard items are selected from a 
set consisting of: 

standard greetings; 

a business address; 

a company profile; 

a uniroj.ni resource locator (URL); 

date, time; 

originator signature. 

149. A system according to claim 143, wherein said structured video message is an 
instantiation of a video message template. 

150. A computer readable medium for storing a program for apparatus which processes 
data, sakt processing comprising a method of conveying a video message over a network, 
wherein said video message includes ai least a video image and an associated audio 
message, said program comprising: 
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code for capturing said video message on a first apparatus ; 
means for processing said captured video message to provide a structured video message, 
wherein said structured video message is represented as a structure to allow originator 
labelling, navigation, editing and annotation capabilities; and 

code for transmitting tijc structured video message to at least one second 
apparatus; 

code for receiving said structured video message at the at least one second 
apparatus; 

code for processing and viewing, by a recipient, said received structured video 
message in accordance with said structure. 

151. A computer readable medium according to claim 150, wherein said structure 
further allows the recipient labelling, navigation, editing and annotation capabilities, 

152. A computer readable medium according to claim 150, wherein said structured 
video message is an instantiation of a video message template, 

153. A method of creating a structured video message comprising the steps of; 
providing a video message structure; 

capturing video data in accordance with said video message structure to produce a 
structured video message. 

154. A method according to claim 153, wherein said video message structure includes 
at least one node and said capturing of the video data further includes linking at least one 
node of the video message structure with a segment of the video data. 

155. A method according to claim 154 t wherein linking a node with a segment of the 
video data includes associating a start time position and an end image data oi : the segment 
of video data with said node. 

156. A method according to claim 154, wherein linking between nodes and video data 
segments is performed during capture of the video data. 
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157. A merhod according to claim 153, wherein said video data includes image data 
and associated audio data. 

158. A method according to claim 153, wherein said structured video message is a a 
instantiation of a video message template. 

159. An apparatus fo r creating a structured video message comprising; 
means for providing a video message structure; 

means for capturing video data in. accordance with said video message structure to 
produce a structured video message. 

160. Ail apparatus according to claim 159 t wherein said video message structure 
includes at least one node and said means for capturing video data further includes means 
for linking at least one node of the video message structure with a segment of the video 
data. 

161. An apparatus for capturing a video message comprising; 
a video camera unit for capiuring video data; 

a capture manager responsive to capture commands for controlling the video 
camera mVit and receiving the captured video date*; 

a user input interface for generating user commands; 

a message structure editor responsive to said user commands for providing a video 
message structure, generating said capture commands and for associating the video 
message structure with at least one segment of the captured video data to provide a 
structured video message. 

162. An apparatus according to claim 161> wherein said capture manager provides 
timing position information for the captured video data aud the message structure editor 
uses said timing position information to associate the video message structure to the 
segment of the captured video data* 

163. An apparatus according to claim 162, wherein said video message structure 
includes at least node and said timing position information is associated with the node(s) 
of the structure. 
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164. Aft apparatus according to claim 161, wherein the apparatus- fortius* includes a first 
storage area tor storing said captured video data and a second storage area for storing the 
associated video messagje structure. 

1<55„ An apparatus according to claim 161, wheuein the apparatus further includes a 
user output interface and a video playback unit for viewing at least part of the structured 
video mess&ge. 

166\ An apparatus according to claim 165, wherein the message structuie editor further 
generated playback commands said video playback unit is responsive to playback 
commands. 

167. An apparatus according to claim 159, wherein said structured video message is an 
instantiation of a video message template, 

168. A computer readable medium ibr-storing a program for apparatus which processes 
data, said processing comprising a method of creating a structured video message* said 
program comprising: 

code which is responsive to capture commands lor capturing video data; 
code for getsciatirsg, user commands; 

code which is responsive to said user commands for providing a video message 
structure, generating said capture commands and for associating the video message 
structure with at least oiie segment of the captured video data to provide a structured 
video message. • 

169. A computer readable medium according to claim 163, wherein said code for 
capturing video data further provides timing position information for ihc captured video 
data and said means for providing a video message structure uses said timing position 
information to associate the video message structure to the segment of the captured video 
data, 

170. A method of editing a video message wherein said video message is represented 
as a video message structure, including a plurality of nodes, said method including the 
Steps Of; 

storing said video message in a memory; 
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manipulating said nodes to place said video message in a desired format, wherein 
at least one node represents a segment of said video message. 

171. A method according to claim 170, wherein additional nodes representing further 
captured video are added to said video message* 

172. A method according fo claim 170, wherein unwanted nodes arc deleted from said 
video message structure so that only wanted information in retained. 

173. A method according to claim 172, wherein a segment of said video message that is 
represented by a deleted, node k retained in said memory. 

174. A method according to claim 170, wherein said video message structures allows 
said originator to include at least one of a plurality of standard items in said video 
message. 

175. A method according to claim 174, wherein suid standard items include at least 
standard greetings, a business address and a company profile, 

176. A method according to claim 170, wherein each node is labelled, 

177. A method according to claim 1 76, wherein said label relates to the content of said 
video segment 

178. A method according to claim 176, wherein said label is able to be edited. 

179. A method according to claim 170, wherein navigation of said video message 
allows said originator or a recipient of said video message to pause and restart said video 
message. 

ISO. A method according to claim 170, wherein navigation of said video message 
allows said originator or a recipient of said video message to cue to a position in said 
video message. 
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181. A method according to claim 170, wherein said video message structure indicates 
a current position within said video message when played. 

182* A method according to claim 181, wherein said current position is indicated by a 
karaoke -siyie ball displayed within satd video message structure. 

183. A method according to claim 181, wherein said current position is indicated by 
highlighting current text within said video message structure. 

1.84. A method according to claim 181, wherein said current position is indicated by 
displaying corresponding text of any video sequence at the base of a display upon which 
said video message is being viewed. 

1 85. A method according to claim 170* wherein said video message is an instantiation 
of a video message template. 

186. An apparatus for editing a video message wherein said video message is 
represented as a video message structure including a plurality of nodes, said apparatus 
including: 

means for storing said video message in a memory; 
means fur displaying said video message stmctnre; atid 

means for manipulating said nodes to place said video message in a desired format, 
wherein at least one node represents a segment of said video message. 

187. An apparatus according to claim !86, wherein additional nodes representing 
further' captured video ate added to said video message, 

188. An apparatus according to claim 186, wherein said video message is an 
instantiation of a video message template. 

189. A cojRpatci readable medium for storing a progiam for apparatus which processes 
data, said processing comprising a method of editing a video message wherein said video 
message is represented as a video message structure including a plurality of nodes, said 
program comprising: 

code for storing said video message in a memory; 
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code for displaying said video message structure; and 

code for manipulating said uodes to place said video message in a desired format, 
wherein at least one node represent a segment of said video message. 

190. A computer readable medium according to claim 189, wherein additional nodes 
representing fimlhei caplurcd video are added to said video message, 

191. A computer readable medium according to claim 189, wherein unwanted nodes 
arc deleted from said template structure so that only wanted information in retained. 

192. A computer readable medium according to claim 191, wherein a segment of said 
video message that is represenled by a deleted node is retained in said memory. 

193* A computer readable medium according to claim 189, wheiein said video message 
structures allows said originator to include at least one of a pltuality of standard items in 
said video message. 

194. A computer readable medium according to claim 193, wherein said standard items 
include at least standard greetings, a business address and a company profile. 

195. An apparatus according to claim 189, wherein each node is labelled, 

196. A computer readable medium according to claim 195, wherein satd label relates to 
the content of said video segment, 

197. A computer readable medium according to claim 195, wherein said label is able to 
be edited 

198. A computer readable medium according to claim 189, wherein navigation of said 
video message allows said originator or a recipient of said video message to pause and 
restart said video message. 

199. A computer readable medium according to claim 1S9, wherein navigation of said 
video message allows said originator or a recipient of said video message to cue to a 
position in said video message. 
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200. A computer readable medium according to claiml89, wherein said video message 
structure indicates a current position within said video message when played. 

201. A computer readable medium according to claim 200, wherein said current, 
position is indicated by a kraraoke-style ball dispjayed wiihin said video message structure. 

202. A computer readable medium according to claim 200, wherein said current 
position is indicated by highlighting current text within said video message structure. 

203. A computer readable medium according lo claim :>QQ„ wherein said current 
position is indicated by displaying corresponding text of my video sequence at the base 
of a display upon which said video message is being viewed, 

204. A computer readable medium according to claim 189, wherein said video message 
is an instantiation of a video message template, 

2UX A method of generating a video message structure for a video message, said 
video message including video data comprising image data and associated audio data, the 
method including the steps of; 

providing a message template; and 
. executing said message template to generate a video message structure having a 
plurality of nodes, eacli said node being capable of representing a segment of video data 
of said video message. 

206, A method according to claim 205, wherein said video message structure is an 
instantiation of the message template, 

207, A method according to claim 205 ? wherein during execution said message 
template provides guidance lo a user generating the video message structure 

208, A method according to claim 205, wherein the template prompts a user for user 
input information. 
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209. A method according to claim 205, , wherein the template provides a linking 
between ni least one cf said nodes aiid tlte a segment of video data. 

210- A method according to claim 205, wherein the template further sets attributes for 
the video message, 

211. A method according to claim 21.0, wherein the attributes include any one or more 
selected from a set consisting of: 

a tone of the video message, 

an intent of the video message; and 

duration of the video message or part thereof. 

212. An apparatus for generating a video message structure for a video message, said 
video message includes video data comprising image data arid associated audio data, the 
apparatus comprising; 

means for providing a message template; and 

means for executing said message template to generate a video message structure 
having a plurality of nodes, each said node being capable of representing n segment of 
video data of said video message. 

213. An apparatus according to claim 212, wherein said video message structure is an 
instantiation of the message template. 

214. An apparatus according to claim 212, wherein said apparatus further includes 
guidance means for providing guidance to a user generating the video message structure 
during execution of said message template. 

215. An apparatus according to claim 214, wherein the guidance means includes input 
means for inputting user input information in response to template prompts to a user, 

31 6. A computer readable medium for storing a program fox apparatus which 
processes data^ said processing comprising a method of general mg a video message 
structure for a video message, said video message including video data comprising image 
data and associated audio data, said program comprising: 
code for providing a message template; and 
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code for executing said message template to ejeneyate a video message structure 
having a plurality of nodes, each said node being capable of representing a segment of 
video tlata of said video message. 

217. A computer readable medium according to claim 216, wherein said product 
further includes guidance means tor providing guidance to a user generating the video 
message structure during execution of said message template, 

218. A computer readable mcdiura according to claim 217, wherein the guidance 
means includes input means for inputting user input ^formation in response to template 
prompts to a user. 

219. A computer program product according to claim 216, wherein said structured 
video message lis an instantiation of a video message template. 

220. A method of conveying a video message including the steps of: 

capturing video tiata on a first apparatus, wherein said video data includes at least 
image data and associated audio data; 

processing said captured video data to provide a video message, wherein satd 
video message includes said captuied video data and a first video message structure being 
a first instantiation of a message template; 

transmitting said video data and said message template to at least one second 
apparatus; 

receiving the video data and ihe message template at the second apparatus; 
processing said video data to provide a corresponding video message, wherein said 
corresponding video message includes said video data and a second video message 
structure being a second instantiation of said message template; and 

viewing said corresponding video message, 

221. A method accoidkig to claim 220, wherein transmitting said message template 
includes transmitting a reference addiess location for obtainiiig the message template. 

222. A method according to claim 220, wherein transmitting said video data and said 
message template includes transmitting a reference address location for obtaining the 
video data and message template respectively, 

r~rr-M.j- f -j^t u It urt-m rtrf jot-xoflm r:.\-t — l_: \x.t _-o-.i> j,/\jA-n 
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223- A method according to claim 220. wherein the first video message structure and 
the second video message structure are substantially identical. 

224. A method according to claim 220, wherein instantiation of die message template 
provides a customized video .message structure according to predetermined user 
preferences. 

275. A method according to claim 226* wherein said customised video message 
structuf e can be saved as a new video message structure including the user preferences- 

226. A method according to claim 220, wherein the message template prompts a user to 
provides the user preferences. 

227. A method according to claim 220, wherein transmitting includes downloading 
data to be transmitted onto a removable storage medium and conveying said removable 
medium to an intended recipient. 

228. A svstem for conveying a video message including: 
at least one first apparalus including: 

capturing means for capturing video, wherein said video data incindes at least 
image data and associated audio data; 

processing means for processing said captured video data to provide a video 
message, wherein said video message includes said captured video data and a first video 
message structure, said first structure being a first instantiation of a message template; 

means for transmitting the structured video message to at least one second 
apparatus; 

said second apparatus including: 

means for receiving the video data and the message template at the second 
apparatus; 

means for piocessing said video data to.provide a corresponding video message^ 
wherein said corresponding video message includes said video data and a second video 
message structure being a second instantiation of said message template; and 

means tor viewing said corresponding video message. 
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229- A system affording to claim 22&, wherein transmitting said message template 
includes transmitting a reference address location for obtaining the message template. 

230. A system according to claim 228 T wherein transmitting said video data and said 
message template includes transmitting a refeience address, location for obtaining the 
video data and message template respectively. 

231. A system according to claim 228, wherein the first video message structure and 
the second video message structure are substantially identical. 

232. A system according to claim wherein instantiation of the message template 
provides a customised video message structure according to predetermined user 
preferences, 

233. A system according to claim 228, wherein said customised video message 
structure can foe saved as a new message structure including the user preferences. 

234. A computer readable medium for storiug a program for apparatus which processes 
data, said processing comprising a method of conveying a video message, said video 
message including Yidco data comprising image data and associated audjo data, said 
program comprising: 

code lor capturing video data on a first apparatus wherein said video daLa 
includes at least image data and associated audio data; 

code for processing said captured video data to provide a video message, wherein 
said video message includes said captured video data and a first video message structure 
being a first instantiation of a message template; 

code for transmitting said video data and said message template to at least one 
Second apparatus; 

code for receiving the video data and the message template at the second 
apparatus; 

code for processing said video data to provide a corresponding video message, 
wherein said corresponding video message includes said video data and a second video 
message structure being a second instantiation of said message template; and 

code foi viewing said corresponding video message. 
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235. A computer readable medium according to claim 234, wherein transmitting said 
message template includes transmitting a reference address location for obtaining the 
message template. 

236.. A computer readable medium according to claim 234, wherein transmuting said 
video data and said message template includes transmitting a reference address location 
for obtaining the video data and message template respectively. 

3 . Detailed Description of the Invention 

Field of Invention 

The present invention relates to asynchronous video messaging, and in particular, 
to a method and system for conveying video messages- The invention also relates to a 
computer program product including a computer readable medium having recorded 
thereon a computer program for conveying video messages. 

Background of Invention 

There is currently a boom tn the use of asynchronous messaging technologies 
including email and voice-maiL An exceptional volume of messages sent and received by 
corporate and government workers have meant changes in the way in which people 
structure their day and has put an emphasis on managing information flow. The high 
level of messaging is attributed in part to the current difficulty in scheduling synchronous 
communication (face-to-face, telephone, videocoiiference, etc). Synchronous 
communication is considered a luxury put aside for relationship building and immediate 
closure whereas asynchronous communication is used for most other communication. 

Video messaging refers to asynchronous video communication, that is, there is a 
delay between (he generation of a message and its delivery, and typically, communication 
is not simultaneously bi-directional, as opposed to the synchronous communication of 
person-to-person telephone calls or video conferencing. 

Currently, video email products such as "SeeMail" by RealMedia Inc. oi 
"Videolink Mail" by Smith Micro Software Ine are good examples of the state of the ait 
video messaging technology and are largely simple packages which aLC distributed with 
video caplure cards or sold separately and support the basic capture and sending of a 
video message as an email attachment or as the main body of an email, These packages, 
however, do not take advantage of the unique qualities of this kind of message to provide 
support for effective communication, but instead, rely on the conventional capture and 
us^ge model of linear video- jiven where video and/or audio editing capabilities may be 
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provided, it is typical that the sendcE~ t if wishing to review a m&ssagje, or a resilient, must 
conform to tt*e constraints of the conventional linear playing method for video messages. 

Video is a time-based medium and typically requires time e*|ual to Us duration to 
view fully, although there are some video/audio fasi-piay technologies, available which 
provide a particular solution to the dilemma of enforced lines* replay of video/audio 
material, but these amount to fast cuing or fast forwarding of the linear video message. 
Conventional video is a difficult medium to navigate through and manipulate. Feu 
exzirnpie, one possible use for video messages is for a sender to send a weekly report to 
one or more recipients, Such a weekly report cart contain, scattered through its content, a 
set of actions for the various recipients ofthe message. A recipient might view the whole 
message once initially, and need to subsequently access parls of the message when ready 
to perform the actions requested. Doing (his with a conventional video cassette recorder - 
style (VCR-style) interface is very inefficient and in most piacrical situations time 
consuming. 

Tt [s, therefore, an object of the present invention to ameliorate one or more 
disadvantages of the prior ait. 

Summary of the invention 

According to a first aspect of the invention there is provided a method of 
conveying a video message comprising the steps of: 

(i) capturing video data comprising at teas* image data and associated 
audio data; 

(ii) creating a video message structure; 

(ill) establishing a link between said structure and the video data to create a 
structured video message, said structured video message being characterised by a video 
message structure that provides an originator^ of the message, enhanced manipulation 
capabilities for the video data by manipulating said structure; and 

, (iv) conveying the structured video message to a recipient Cor viewing 
and/or for providing said recipient substantially the same enhanced manipulation 
capabilities. 

According to a second aspect of the invention there is provided an apparatus for 
conveying a video message^ said apparatus comprising: 

capturing means for capturing video data comprising at least image data, and 
associated audio data; 
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processing means for creating a video message structure and establishing a link 
between said structure and the video data to create a structured video message, said 
structured video message being characterized by a video message structure that provides 
an ou^inator, of the message, enhanced manipulation, capabilities For the video data by 
manipulating said structure; and 

means for conveying ihe structured video message to a recipient for viewing 
and/oi for providing said recipient substantially the same enhanced manipulation 
capabilities. 

According to a third aspect of the invention there is provided a computer 
readable momoiy medium for storing a program for apparatus which processes data, said 
processing comprising a method of coiiveyiug a video message, said program comprising: 

code for capturing video data comprising at least image data and associated 
audio data; 

code for creating a video message structure; 

code fox establishing a link between sajd structure arid the video data to create a 
structured video message, said structured video message being characterized by a video 
message structure that provides an originator, of the message, enhanced manipulation 
capabilities for the video data by manipulating said s tincture; and 

code for conveying the structured video message to a recipient for viewing 
and/or for providing said recipient substantially the same enhanced manipulation 
capabilities. 

According to a fourth aspect of the invention there is provided a method of 
creating a video message comprising the steps oft 

providing a video message structure including at least one node; 

providing video dafy, said video data comprising at least image data and 
associated audio data; 

associating at least one node of the video message structure witb at least one 
segment of the video data to provide an associated structure; and 

utilizing the associated structure to provided enhanced manipulation capabilities 
of the video data to create a structured video message. 

According to a fifth aspect of the invention there is provided a method of 
creating a video message comprising the steps of; 

creating a video message suueture including at least one node; 
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capturing video data, said video data comprising at least image data and audio 

data; 

linking at least one node of the video message structure with at Least one segment 
of the video data to provide an associated structure; 

storing the video data and the video message structure; and 

utilizing the associated structure to provide enhanced manipulation capabilities 
of the video data to create a structured video message. 

According to a sixth aspect of the invention there is provided an apparatus for 
creating a video message comprising; 

means for creating a video message structure including at least one node; 

means for capturing video data, said video data comprising at least image data 
and audio data; 

means for linking at least one node of the video message structure with at least 
one segment of the video data to provide an associated structure; 

means tor storing the video data and the video message structure;- and 

means for utilizing the associated structure to provide enhanced manipulation 
capabilities of the video data to create a structured video message. 

Accord ing to a seventh aspect of the invention there is provided an apparatus for 
creating a video message comprising; 

a video camera and capture manager for captuiuig video data, said video data 
comprising at least image data and audio daia; 

a message structure editor for creating a video message structure and for 
associating the video message structure with at least one segment of the video data to 
provide an associated structure; ' 

a storage device for storing said video data and the video message structure; and 

manipulation means for using the associated structure to provide enhanced 
manipulation capabilities of the video data to create a structured video message. 

According to a eighth aspect of the invention there is provided a computer 
readable memory medium for storing a program for apparatus which processes data, said 
processing com|^rising a method of creating a video message said program comprising: 

code tor creating a video message structure including at least one node; 

code for capturing video data, said video data comprising at least image data and 
audio data; 

code for linking at least one node of the video message structure with at least one 
segment of the video data to provide an associated structure; 
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code for storing the video data and the video message structure; and 

code for utilizing the associated structure to provided enhanced manipulation 
capabi lilies of ihe video data to create a stiuctured video message. 

According to a ninth aspect of the inversion there is provided a method of 
conveying a video message comprising the steps of: 

providing video data comprising at least image data and associated audio data; 

providing a video message structure; 

establishing a link between said structure and the video data to provide a 
structured video message* said structured video message being characterized by a video 
message structure that provides ata originator, of the message, enhanced manipulation 
capabilities for the video data by manipulating said structure; and 

conveying the structured video message to a recipient for viewing anaYor for 
providing said recipient substantially the same enhanced manipulation capabilities. 

According to a tenth aspect of the invention there is provided a method of 
conveying a video message over a network, wherein said video message includes at least 
a video image and m associated audio message, said method ineludhig the steps of: 

capturing said video cnessage on a first apparatus; 

processing said captured video message to provide a structured video message, 
wherein said structure video message is represented as a structure to allow originator 
labelling, navigation, editing and annotation capabilities; and 

iraxi&rmttiiLg over said network the structured video message to at least one second 
apparatus; 

receiving said structured video message at the at least one second apparatus; 

processing and viewing said received structured video message by a recipient in 
accordance with said structure. 

According to a eleventh aspect of the invention there is provided a system for 
conveying a video message, wherein said video message includes at least a video image 
and an associated audio message, said system including: 

at least one first apparatus including: 

capturing means for capturing said video message; 

processing means for processing the captuied video message to provide a 
structured video message, wherein said structured video message is represented as a 
structure that allows originator labelling, navigation, editing and annotation capabilities; 
and 
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means for transmitting the sirueturcd video message to at least one second 
apparatus; 

said secortd apparatus including: 

means for receiving said str uctured video message: 

means for processing and viewing by a recipient said received structured video 
message in accordance with, said structure. 

According to a twelfth aspect of the invention there is provided a computer 
readable medium for storing a program for apparatus which processes data, said 
processing computing a method of conveying a video message over a aeiwork v wherein 
said video message includes at least a video image aad an associated audio message, said 
program comprising: 

code for capturing said video message on a first apparatus ; 

means for processing said captured video message to provide a structured video 
message, wherein said structured video message is represented as a structure to allow 
originator labelling, navigation, editing and annotation capabilities; and 

code for transmitting the structured video message to at least one second 
apparatus; 

code Tor receiving said structured video message at the at least one second 
apparatus; 

code fox processing and viewing, by a recipient, said received structured video 
message in accordance with said structure. 

According to a thirteenth aspect of the invention there is provided a method of 
creating a structured video message comprising the steps of: 

providing a video message structure; 

capturing video data in accordance with said video message structure to produce 
a structured video message. 

According to a fourteenth aspect of the invention there is provided an apparatus 
for creating a structured video message comprising; 

means for providing a video message structure; 

means for capturing video data in accordance with said video message structure 
to produce a structured video message. 

According to a fifteenth aspect of the invention there is provided an apparatus for 
capturing a video message comprising: 

a video camera unit for capturing video data; 
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a capture manager responsive to capture commands for controlling the video 
camera unit and receiving the captured video data; 

a usee input interface for generating user commands; 

a message stiucture editor responsive to said user commands for providing a 
video message structure, generating said capture commands and for associating the video 
message structure with at least one segment of (he capuaed video data to provide a 
structured Ytdeo message. 

According to a sixteenth aspect of the invention mere is provided a computer 
readable medium for storing a program for apparatus which processes data, Said 
ptocesslag comprising a method of creating a structured video message, said program 
comprising: 

code which is responsive lo capture commands for capturing video data; 
code for generating user commands; 

code which is responsive to said user commands for providing a video message 
structure, generating said capture commands and for associating the video message 
Structure with at least one segment of the captured video data to provide a structured 
video message. 

According to a seventeenth aspect of the invention there is provided a method of 
editing a video message wherein said video message is represented as a video message 
structure including a plurality of nodes, said metliod including the steps of: 

storing said video message in a memory; 

displaying said video message structure; and 

manipulating said nodes to place said video message in a desired format, wherein 
at least one node represents a segment of said video message, 

According to a eighteenth aspect of the invention there is provided an apparatus 
for editing a video message wherein said video message is represented as a video message 
structure inc hiding a plurality of nodes, said apparatus ineluding: 

means for storing &aid video message in a memory; 

means for displaying said video message structure; and 

means for manipulating said nodes to place said video message in a desired 
format, wherein at least one node represents a segment of said video message* 

According to a nineteenth aspect of the invention there is provided a computer 
readable medium for storing a program for apparatus which processes data, said 
processing comprising a method of editing a video message wherein said video message 
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is represented as a video message structure including a plurality of nodes, said program 
comprising: 

code foi storing said video message in. n memory; 
code for displaying vsaid video message structure; and 

code for manipulating said nodes to place said video message in a desired formal 
wherein at least one node represents a segment of said video message. 

According to a twentieth aspect of the invention there is provided a method or 
generating a video message structure for a video message, said video message including 
video data comprising image data and associated audio data, the method including the 
steps of: 

providing a message template; and 

executing said message template to generate a video message structure having a 
plurality of nodes, each said node being capable of representing a segment of video data 
of said video message. 

According to a twenty-first aspect of the invention there is provided an apparatus 
for generating a video message structure for a video message, said video message 
includes video data comprising image data and associated audio data, the apparatus 
comprising; 

means for providing a message template; acid 

means for executing said message template to generate a video message structure 
having a plurality of nodes, each said node being capable of representing a segment of 
video data of said video message. 

According to a twenty-second aspect of the invention there is provided a 
computer readable medium for storing a program for apparatus which processes data, said 
processing comprising a method of generating a video message structure for a video 
message, said video message including video data comprising image data and associated 
audio data, said program comprising: 

code for providing a message template; and 

code for executing said message template to generate a video message structure 
having a plurality of nodes, each said node being capable of representing a segment pi 
video data of said video message. 

According to a twenty-third aspect of the invention there is provided a method of 
conveying a video message including the steps of: 

capturing video data on a first apparatus, wherein said video data indudes at 
least image data and associated audio data; 
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piocessing said captured video data to provide a video message, wherein said 
video message includes said captured video data and a first video message structure being 
a first instantiation of a message template; 

transmitting said video data and said message template to at least one. second 
apparatus; 

receiving the video data and the message template at the second apparatus; 

processing said video data to provide a corresponding video message, wherein 
said corresponding video message includes said video data and a second video message 
structure being a second instantiation of said message template; and 

viewing said corresponding video message. 

According to a twenty-fourth aspect of the invention there is provided a system 
for conveying a video message including: 

at Jeast one fust apparatus including: 

capturing means for capturing video, wherein said video data includes at least 
image data and associated audio data; 

, processing means for processing said captured video data to provide a video 
message, wherein said video message includes said captured video data and a first video 
message structure, said first structure being a first instantiation of a message template; 

means for transmitting the structured video message to at Least one second 
apparatus; 

said second apparatus including: 

means for receiving tbe video data and the message template at tiie second 
apparatus; 

means for processing said video data to provide a corresponding video message, 
wherein said corresponding video message includes said video data and a secoud video 
message structure being a second instantiation of said message template; and 

means for viewing said corresponding video message. 

According to a twenty-fifth aspect of the invention there is provided a computer 
readable medium for storing a program for apparatus which processes data, said 
processing comprising a method of conveying a video message, said video message 
including video data comprising image data aud associated audio data, said program 
comprising: 

code for capturing video data on a first apparatus* wherein said video data 
includes at least image data and associated audio data; 
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code for processing said captured video data to provide a video message, 
wherein said video message includes said captured video data and a first video message 
structure being a fust instantiation of a message template; 

code fur transmitting satd video data and said message template to at least one 
second apparatus; 

code for receiving the video data and the message template at the second 
apparatus; 

code for processing said video data to piovide a corresponding video message 
wherein said corresponding video iitessa£e includes said video data and a second video 
message structure being a second instantiation of said message template- and 

code for viewing said corresponding video message. 

Detailed Description 

Introduction 

Where reference Is made in any one or more of the drawings to steps and/or 
features, which have the same reference numerals, those steps and/Oi features are for the 
purposes of the description the same, unless otherwise indicated. 

The video messaging system may be embodied in several alternatives or 
combinations involving some variations in functionality and application. Several of such 
alternative embodiments arc preferentially described herein, 

A video message as used herein is defined as typically including a video 
component and an optional audio component. Wi*hin the scope of the preferred 
embodiments, hut without restriction, it would be typieaily expected that video and audio 
components of a video message would be captured simultaneously and with relative 
synchronism {or lip-sync) a«d also manipulated, transmitted, relayed, received, presented 
or replayed similarly in a relatively synchronous manner or in such a way as to preserve 
or recreate the original relative synchronism* 

A viueo message, typically comprising a video and a relatively -synchronous 
audio component but may also includes other comiK>neiit& as relevant to a particular 
embodiment or as an extension to any of the embodiments hereinafter described. 
Examples of additional or extension components are hyperlinks or Uniform Resource 
Locators (UKLs) referencing other streams, media or documents, included streams, media 
or documents of any kind, or insertions or dubs within the audsio or video components or 
bath. As will be described for some of the embodiments, a video message ? in some 
circumstances, may also include a structure, a template, a reference to either, some 
portion of either or related instruction for recreating a structure template at the receiver 
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tor a video message, in which case the term compound video message will be typically 
assigned to video messages meeting this description, and otherwise, the terms, video, or 
video message, may include reference to any or all of the abov£?-menUoue<t extensions or 
additional media, including audio. 

The following text, without restriction and for purposes of ciarity 5 defines 
various terms utilised within this document in the context of video messages and 
associated video message structures. A video message is typically a linear, conventional 
message, as described above* which may contain one or several distinct topics, or topics 
which may be arbitrarily distinguished, and each topic may be represented by any 
reasonable textual description* reference or similar title, and preferably being 
distinguishable by same, A video message structure may include a software, hardware, 
computing entity, data stream, memory or stojage coiifi*suration 4 a mathematical equation 
04 equivalent capable of representing at least part of a hieiarchical structure including one 
or more nodal entities (nodes) within the structure* Each node will be capable of 
comainiag one, two or a greater number of references to temporal points within one or 
more video messages, but without requirement to necessarily contain any, or any 
particular number of actual references- Each node will preferably contain or leference a 
label typically comprising a textual string. Throughout the various embodiments a typical 
method of creating an association between a video message and a video message structure 
will include an assignment of one or more references to temporal points) within a video 
message to one or more nodes within a hierarchical structure^). The method will 
typically assign one temporal reference to one node to represent a zero-length temporal 
point within said video message or will typically assign two linearly-related temporal 
references to a single node to typically represent a video sequence beginning at the 
earliest reference and ending at the later reference within the sequential time-frame of the 
video message. Typically, the node for either typical case will also be assigned a label, 
typically describing the topic or content or position within some interpreted structure or 
Other parameter xefevant to the referenced sequential portion or reference point within the 
video message. 

The nodes, topics or labels may be used inter changcably in some contexts, 
without restriction, to imply or combine or infer some or all properties of each or any Co 
die extent that the implied or combined or inferred grouping of properties may be 
reasonably intended or understood to be practical or possible in the context. 

The previously described hierarchical structure and any components thereof 
including nodes, references, labels, associations, etc may be partially or entirely visible 
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and accessible to a user or may be partially or entirely invisible or inaccessible to a user, 
depending on issues including preferred design of any particular application uf the 
tnven^on and said visibility or accessibility may vary depending upon desired options and 
applicability to the particular application. 

The video messaging components or systems described herein can be 
implemented on a large number of available computer systems and using any of a large 
number of computer languages, or alternatively, may be implemented by some hardware 
circuits) or a combined hardware and software implementation.. At the present time, the 
inventors have implemented such a video messaging system rising tSie Java programming 
language of Sun Microsystems Inc. (Java is a registered trademark). Efowever the 
implementation of the present invention is not limited to any one specific computer 
system or computer language or hardware device, but can be implemented any one of a 
multitude of combination without departing from the scope and spirit of the invention. 
For example, the invention can be implemented using PASCAL pmpjamrning language 
on a personal computer having a modem connected to a computer network via a telephone 
line* 

First Embodiment 

Referring to Fig. 1A, there is illustrated s first preferred embodiment of the 
invention in which a sender system 100 provides capture capability for video messages. 
The system 100 can be described as a sending station for video messages, but this 
description docs not Imply a requirement that the station transmit video messages, but 
rather provides a genera] description of the typical functionality and application of this 
embodiment. The sending station 100 for video messages is typically be used to send 
video messages without also sending an associated or related video message structuie as 
will be described. The present embodiment provides to a sender 103 enhanced 
capabilities including structured video capture, editing or otherwise manipulation 
capabilities of a video message, but sends or provides to a recipient of the video message 
a conventional linear (unstructured) video message. 

The embodiment includes a video capture device, typically associated with an 
audio capture device, both being illustrated in Fig. 1A within a representative capture 
device 102. The capture device 102 is connected to a general purpose coxnputing device 
101 (eg, personal computer). Alternatively a specific, dedicated or embedded device 
designed to support the functionality as hereinafter described can be used to implement 
the present embodiment without departing from the scope or spirit of the invention. The 
video and audio capture system includes for example: a camera, camcorder or other visual 
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and audio sensor system; and interfacing and conversion hardware and/or software 
components to interface with general purpose computing device 101. for providing control 
and data conversion facilities. The sending station 100 further includes a communication 
link: 104 (or transmission link) to a computer network or alike for transmission of a video 
message to a recipient, Optionally, the communication of the video message can be 
effected by storing the message on a removable storage medium, sucli as a floppy disk 
105^ to be sent to the recipient by conventional methods (eg: post). Other removable 
media include CD-ROM, CD-R, CD-RW, DVD and alike. T»e list of removable media is 
non-exhaustive and Other memory capable can be m\m ituted without departing from the 
scope and spirit of the invention. 

The video messaging sending station 100 further comprises: a video and/or audio 
player for viewing the captured video message; and. a message structure editor for editing 
a structure and/or content of the video message. Preferably, the video and/or audio player 
and the message structure editor is implemented in software as a software application on 
the general purpose computing device 101. 

Referring Fig. IB tiiere is shown a capture manager 106, a video player 109, a 
message structure editor 107 and a communication manager 108, The capture manager 
106 controls a capture device 102 to capture video data which is typically seat 113 to the 
message structure editor 107. In general terms, the user 103 can initiate an operation on a 
video message by peifurming a comsrxmding operation on the video message structure 
using the message structure editor 107. The message structure editor 107 intetprets the 
user operation and sends commands 110 to the capture manage to capture a video 
message in accordance with the (cheated) associated video message structure or sends 111 
commands nnd video data to the video player 109 so that subsequent video playing is in 
accordance with the video message structure. Operation of the video player 109 may 
result in commands or data flowing 112 to the message structure editor 107, For example 
commands may include: cnrreni position information, timing information and/or current 
play status (forward, reverse stop, pause and video segment completed). The user 103 is 
able to initiate transmission of a video message, through a video data line 129, which is 
handled by the commimication manager 108 to a network 115. Typically the 
transmission is of a linear video message, however as described hereinafter with reference 
to the third embodiment the associated video message structure can also be transmitted. 

Fig 1C shows a dataflow diagram performed during operation and the flow of 
data between the devices of Fig IB, However before describing Fig. 1C in more detail it 
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is convenient to first describe some of Che runctiorialrty and capabilities of the present 
embodiment. 

Referring to Fig. 2 there is shown an example of the viden player 200 
implemented with a graphical user interface (GUI) on the computing device 101 of 
Fig. 1A. "ITie video player 200 comprises: a viewing area 201 for viewing a captured 
video message; and a plurality of control buttons 202 for operating the video player 200. 

Turning to Fig. 3 there is shown a GUI for the message structure editor 300. The 
message structure editor 300 provides functionality for any one or alt of the following 
functions: planning, capturing, labelling^ navigating, editing., and annotating a video 
message by utilising a structmal representation of the message or intended message. A 
plurality of buttons 301 and a "pull-down" menu 302 provides the user 103 (sender) the 
necessary control over the editor 300 to perform the functions described above and as 
well as othe/ somewhat standard functions not so described (eg. Save, Save As, New, 
Properties etc). Fig. 3 also sliows a coliapsed tree structure 303 (ie, the foot node of the 
tree) of a video message in relation to the example to be described with reference Pig. 5. 

A video message structure represents "themes" or "subject matters" oi: a video 
message as they appear sequentially in time and, when appropriate, as they are related 
from generic to specific in *i hierarchical fashion. 

Referring to Fig. 4, there is shown a partially expanded tree structure 40t foi the 
collapsed tree structure 303 shown in Fig. 3 and represents an example of a video 
message structure that corresponds to the topic structure and content of a video message 
containing a progress report. 

Fig. 5 shows a fully expanded tree structure 500 of the example of Fig 4. The 
tree structure 500 contains labels &t several hieraichical levels indicating a useful 
declaration or implication about the video message structure, content or other (useful) 
dimensions. In the example of Fig. 5, the hierarchical structure indicates a major 
structural node 501 (and associated label) of the progress report video message as well as 
content headings (label) 502 within that structure 500. The example contains only 
sequence label s which are a&$ocia?ed with a non-zero length of video message . 

The Sending Station 100 will provide at least one and preferably all of the 
following video messaging capabilities: 
Video message planning; 
Video message capturing; 
Video message labelling; 
Video message navigating; 
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Video message editing; and 
Video message annotating. 

The above list of capabilities will be referred lo hereinafter, as "sending station 
structured video message capabilities 11 , 

inferring again to Fig. 1C which as previously described is data How diagram 
for the present embodiment, there is shown a user interface 120 which allows the user 103 
to inier&ct with the sending station 100. The data flow is lo some extent dependent 
operation requested by the user, thcrufoie, the data flow for Fig. 10 will be discussed in 
more detail with regard jo each of the sending station structured video message 
capabilities. 

(i) Video message planning: the message structure editor 107, under control 121 of 
tiie user 103, creates and modifies a video message structure In memory and 
corresponding changes are made to a screen representation of the message 
suueture ixt the user interface 120, The video message structure is also saved 134 
to disk in a video message structure file 122. The video message planning stage, 
there is no video message so there is no need for the message structure editor 107 
to exchange commands or data 111, 112 with the video player 109. 

(ii) Video message capturing: the capture manager 106, under control 121 of the user, 
initiates capture using the capture device 102. As the capture progresses, the 
video is saved in memory or to a storage device and time position information is 
sent 123 by the capture manager to the message structure editor 107. White 
capturing, the user 103 can indicate to the message structure editor 107 > the topic 
that is about to be addressed. This indication can be made by clicking on a 
corresponding node label, of the created (modified) video message structure, using, 
for instance, a mouse. The message structure editor 107 then associates a 
reference to a time position within the video with the corresponding node of the 
structure. 

(iii) Video message labelling: the message structure editor 107, under control 121 of 
the user, creates and/or modifies a video message structure in memory and 
corresponding changes ate made to the screen representation of this structure as in 
Ihc message planning stage. The user also controls 1.24 the video player 109 and 
video time position mfoirnatian is sent 112 from the video player 109 to the 
message structure editor 107. The time position information may be a single time 
point or two time points indicating the start and end of a sequence of video data. 
The message sLmcture editor 107, under the control 121 of the user 103, is able to 
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associate a reference to that time position, or references to those time positions, 
with a node of the structure selected or ideutiHed in some way by the user 103 
(typically the selection of the node is by an input device such as a mouse). 

(iv) Video message navigating; In this case, the message structure editor 107, under 
control 121 of the user (for example, when the user has clicked on a labci whicli 
has a reference to a video position generated in part, (iii) "video message 
Labelling"), can send HI a command to the video player 109 to start playing the 
video message from a specified time position. In addition, the video player 109 
can icad 125 the video message structure from a video message structure file 122. 
This allows the video player lo display the label of the currently playing position 
within the video if this has been indicated as desirable by the user 103. Also, as a 
video message is being played by the video player 109, time position information 
is sent 112 to the message structure editor 1.07. The message structure editor 107 
can use this information to indicate 126, within the displayed video message 
structure, the current position of the video being played. 

(v) Video message editing: the message structure editor 107 T .under control 121 of the 
user, manipulates the video message structure in memory and corresponding 
changes are made to the screen representation of this structure. An existing or 
previously created video message structure can be read 135 from a video message 
structure file 122 and after any change to the structure, the message structure 
editor saves 134 the video message structure to the video message structure trie 
122 whicli the video player 109 can access* When the user 103 now uses the 
video player 109 to play a video message, the video message defined by the newly 
edited message structure (which specifies which sequences of video to play and in 
what order) ts pJayed. When the user 103 indicates to the message structure editor 
107 that new video message contents are to be inserted into the message* the 
message structure editor 107 sends 110 a command to the capture manager 10f> to 
start capturing video. When a capture is terminated, typically by the user 103, the 
capture manager 106 sends timing information to the message structure editor 107 
and the message structure editor 107 associates references to a starting and ending 
positions of the video data captured to a corresponding node of tbc video message 
structure. Optionally, the timing information be sent to the message structure 
editor 107 upon each start and stop of the video capture process rather that when 
the capture is terminated. 
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(vi) Video message annotating: again, the message structure editor 107, under control 
121 of the user, creates and modifies annotations that are associated with labels at 
nodes in a video message structure. 

(vii) Video message transmitting: the communication manager 108, under control 127 
of the user 103, transmits the video data from a video data rile 128 which stores 
captured video data received 129 from the capture manager 106 and transmits the 
video data to an intended recipients). 

The video player 109 extracts 133 from Che video data file 128 Hie video data 
portion of a video jnessage and sends 130 a video message to be displayed to the use* 
interface 120. Optionally, the video data can be viewed, whether captured or not, via an 
additional path 131 from the capture manager 106 to the user interface 12Q. ha addition to 
the video capture using a video message structure (ic. via the message structure editor 
107), the user 103 has the option to direct 132 capture commands to the capture mana£er 
109 to direct a capture of video in a manner analogous to conventional video capture 
devices. This option of direct capture of video data without the use of the message 
structure editoi 107 can serve, for example, instances where video data is capture directly, 
stored and a message structure created at a Later stage. 

Turning to Fig. ID there is shown a state transition diagram for the message 
structure editoi module 107 of Fig, 1C. From an initial siate 138 were no video message 
structure is loaded into the message structure editor, one of three options can be taken by 
the user 103 for viewing aud/or editing a video message structure. The three possible 
options are; a) opening 140 an existing (ie: previously created) video message structure; 

b) creating 141 a new video message structure albeit an empty one (at least initially, until 
nodes, labels and timing information is associated with the structure and/or video data); or 

c) creating 142 an initial structure from a template (this option is described with reference 
to the fifth embodiment of the present invention hereinafter). Each of these three options 
puts the message structure edito* 107 into a viewing and editing message structure state 
139. in this state 139, the user 103 can then; add, delete, move andVor select a node 143; 
add, delete, change and/or select a label for a node 144; expand or collapse a node 146; or 
annotate a node 147, 

Additionally, the video player 109 can direct 145 (via feedback commands on 
Sine 112) the message structure editor 107 to "set start time position 11 or ? f set end time 
position", as described above for 'Video message labelling 11 item (til), a given time 
position is associated with the currently selected node. 
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Further, the video player 109 notifies 14S the message structure editor 107 of a 
current position of a video bein& played, as described above with reference to item (iv) 
"video message navigating", the display of the video message structure is updated to 
emphasise the corresponding node of the video message structure. 

The capture manager 106 notifies ISO the message structure editor 107 that 
capture has been started, die message structure editor 107 enters a "capturing" state 160. 
In this state 160, when a node is selected, the current time position is associated with the 
node as its start position and the display (user interface) 120 is updated to indicate that the 
captured video is to be associated 153 with this node. When the user indicates that 
capturing for this node is completed or that capturing for another node is to begin, the 
new current time position is associated 152 with the node as its end position. In the lattci 
case (ie. captunag another node), the new current position is also set 153 as the start 
position for the newly selected node. 

Optionally, during capture* <he video message structure display can be modified, 
for example, by expanding and collapsing nodes 154. The display is updaicd accordingly, 

Tiie capture manager 106 notifies 155 the message structure editor 10/ that 
capture has ended, the message structure editor 107 returns to tjj,e slate for viewing and 
editing the video message structure 139 

The sending station structured video message capabilities can be used, for 
example, by a video message sender 103 for creating video messages. Such video 
messages can be can be viewed usiug conventional video playing techniques (for example, 
VCR-like controls) provided by conventional "user interfaces" video playing tools aud/or 
applications represented by the GUI of Fig 2, 

A video message structure, whether created by a sender prior to capturing a 
message, by a sender subsequent to capturing a message or by another predetermined 
mechanism (eg. automatic node/structure generation by specific events in a video 
message, like a transition from one shot to another), provides a representation of a video 
message and can be used for forms of automated processing of that message. For 
example, a video message structure can be used to provide an index for a video message 
that can Jater be used to facilitate searching for message content. For another example, a 
video message structure can be used as a basis for routing a video message to a specific 
person or role within an organisalion (for example, as part of a call centre function). 

Additional features of the sending station video message structure and the 
associated functionalities and capabilities in accordance with the first preferred 
embodiment will now be described in more detail. 
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Video M<3ssag* Planning 

Video message planning allows the user to <uea<e and modify a structure that 
represent the intended structure of topics for a video message to be captured, This 
structure could take the form of a list of topics or could be a hierarchical structure with 
nested icpics with any number of levels. This structure can then be used by senders of 
video messages when capturing a video message. Figs, 3, 4, 5 show aa example structure 
at varying levels of hierarchical expansion. In Fig, 5 the entire ttee structure is apparent, 
showing topics ( labels associated wilh topics) at all levels. 

The operations available to a user for video message planning include: 

Creating a video message structure 

Adding a new node 

Removing a node 

Moving a node within the structure 
Labelling a node 
Changing the label of a node 
Removing the label of a node 

Showing or hiding specific sub-trees of the structure by expanding or collapsing 
nodes 

Video Message Capturing 

Video message Uiptuang allows the user to record a message utilising the video 
message structure. While recording, the sender 103 can indicate when ihey start a new 
topic (for example, clicking on the node m the structure representing the topic 
commenced). This indication allows the system to create an association between topic 
nodes in the structure and the corresponding time positions in the recorded video message- 

The video message structure can also be used, purely for providing the sender 
103 with guidance while recording the message. Correspondences between time 
positions within the video and nodes of the structure might be made after capture is 
complete (discussed under 11 video message labelling 1 '), 

A variation (optional) for providing associations between the message structure 
and the video message involves the sender 103 indicating to the system when they start or 
slop a new topic and having die video capture start and stop at the time that indication is 
made. This results in separate shots of video tor each topic within the message rattier 
tiian a single shot as in the technique above. A combination of these two approaches can 
be used. 
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Video Message Labelling 

Video message labelling allows the user 103 to create nodes within (lie video 
message structure representing a video message and to create labels (textual of otherwise) 
for these nodes. These nodes are associated wuh specific points or sequences in the video 
message and the label can fee used to describe or augment the video message content at 
that point or within thai, sequence, These labels can be used for subsequent navigation, 
editing, eta 

The operations available to a user include those identified above for video 
message planning with the additional capability that nodes, and hence labels, can be 
associated wish a specific position or sequence within an existing video message. The 
means for a user to indicate the specific position or sequence within the video message 
include the use of the current playing position of the video, user-marked in-poiots and 
out-points* and any other form of indication of video positions or sequences. 

Video message labelling can be made available to Lhc sender 103 of a video 
message in order to create a video message structure for their own use for performing 
structured video message capabilities (such as navigation and editing). 
Video Message Navigating 

Video message navigating allows the user 103 to cue to a position in the video 
message using the video message structure (for example, by clicking on a node in the 
video message structure, the playing of trie video message could be cued lo the 
corresponding position within the message). 

During navigation, the display of the video message structure can be manipulated 
by a user, for example expanding a node to show the partially expanded tree structure 401 
(or sub-tree) of Pig, 4 or hide the sub-tree m the collapsed tree structure 303 of Fig- 3, 

The display of the video message structure can also be modified to provide 
feedback to the user with regard to the current position within the video. For example, 
the current position within the video can be indicated on the video message structure 
display by showing a Karaoke-style "bouncing ball", or the node corresponding to the 
current position within the video could be highlighted in some way. 

In addition, when a video message is being played, the label from the node 
corresponding to the current position in the video can be displayed near the video display. 
This can, for example, take the appearance of a caption below die video, above the video, 
beside the video or overlaid on top of the video. 

Video message navigation can be made available to ihe sender .103 of a video 

message. 
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Characteristics of the video message editing process 

Some of the characteristics editing of (asynchronous) video messages include: 

Typically comprises a single source of video - ie. the video woufd usually have ail 
been shot at the same sitting even if in multiple takes. 

Typically comprises a single stream of media - eg., there would not usually be 
overlaying of a part of an audio track onto a particular portion of a video track. 

The editing typically happens in the same place and around the same time as the 
capture, Therefore getting more footage to make a point is often easy and straight 
forward. 

Video messages can be sent often but the editing of them is typically performed on 
an occasional basis. So editing should be a simple extension of normal sending rather 
than a task in its own right. 

The changes made to the source can be minimal (for example, deleting one 
sentence). 

The objective is noi the creation of a well-crafted production but rather the creation 
of an effective message and issues such as the aesthetics may typically not be of high 
importance. This can result in there being more of a focus on rapid (and possibly 
rough) editing as opposed to careful precise frame-accurate editing. 

The expected users of video message editing are unlikely to have special editing 
skills, as opposed to users of conventional (synchronous) video editing tools who 
would probably have received specialised training m the editing process. 

The main message content is likely to be in the audio component, with the video 
component enriching the message. 

The person appearing in the video is usually the same person as the editor. This can 
affect aspects of what type of footage is cut ou< as influenced by the user's conception 
of themselves. 
Video Message Editing 

Video message editing allows the user to manipulate the video message structure 
in order to delete a sequence in a video message* move a sequence in the video message 
to another location within the message, extract a sequence from a video message to be 
used in another message or be used by another application. The user 103 can also use the 
video message structure to position an insertion point few" further video capture, the 
captured video being placed at that position within the video message, 

in the present embodiment there is a distinction between manipulating the video 
message structure without altering the video message (as is described above within "video 
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message planning") and manipulating the video message structure when the objective is 
to perform an analogous operation Oft the corresponding video message. For the latter 
case, an example is indicated in Fig, f>, in which portions of the video message structure, 
602* 603 are to be deleted. This operation will also delete or make unavailable the 
portion of the video message corresponding to the label or labels, 602, 603 deleLcd from 
within the video message sUueture. Fig. 7 indicates the structure portions to be deleted 
and Fig. $ indicates the result following the deletion in which labels indicated by 
reference numerals 601 and <H)4, previously separated by two nodes (labels) 602 and 603, 
are now adjacent nodes of the tree. Note that the exact effect on any video or audio 
message portion formerly corresponding to a deleted portion of a structure (eg. 602, 603} 
may be optional. For instance, the corresponding video or audio portion may actually be 
deleted from a fde or other media, or the corresponding video or audio portion may be 
skipped or not accessed during subsequent playing, but without being removed or deleted 
within a streaming, file-based storage, presentation or transfex of video and audio 
associated with a video message structure. 

Preferably, the message editing support can be used to allow the user 103 to craft 
a message in substantially the same way that most users craft "textual electronic raail" (or 
email) messages by adding here, taking away mere, moving here and/or generally making 
the message say something that they are satisfied with sending. 

As discussed above, users can utilise the tree structure to manipulate a video 
message in accordance with the preferred embodiment. Thus, users can select, expand, 
and collapse a tree node by clicking (ie. selecting wiih an input device such as a mouse 
(not shown)) on a specific portion of the structure. After a tree node has been selected, 
users can either move it to a new location by dragging and dropping, delete it, or change 
its label. Note that in the preferred cmlx>dixnent the insertion of the selected node is enter 
a position before the node where it is dropped {"drag and drop tr ). It is eEivxsaged, however, 
that other equally appropriate or desirable techniques of interactivity or control during a 
.move function can be adopted without departing from the scope and spirit of the 
invention. For example, a cut and pasting on the nodes (or label) to effect a move 
function. Fig. 9 indicates an example tree structure prior to a portion of it being moved. 
Fig. 10 indicates the portion to be moved, corresponding to 902 in Fig. 9> Fig. 11 
indicates the result after the move operation, note the modified siecruen.ee of marked 
portions 90 L through 905 compared to the sequence prior to the move shown in Fig. 9, 

Video message editing can be made available to the sender 103 of a video 
message in order to assist in the creation of a video message. 
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Video Message Annotating 

Video message annotating «Uows the user to provide annotations on the nodes of 
a video message structure with these annotations providing additional information for me 
maker of the annotation or atheism 

A conventional text "email 1 may be subjected to various forms of processing by 
user. These include reading it, performing actions requesled within the message, 
performing actions necessary because of the content of the message, replying to it, using 
its contents in further activities, storing it in such a way that it can be found ai a later date, 
forwarding it and destroying it 

Similarly, a video message can be subjected to this type of treatment. There are, 
however, difficulties that arise due to the time-based nature of the video content For 
example* in the case of text emails, there would usually be an inilial reading of the 
message and, if there arc requested or required actions, these would often be done in 
conjunction with further readings of parts of the email. To enable the same form of 
handling of video emails, it is important thai the video message be able to be quickly 
navigated and key fractions within the video found quickly. 'Hiis functionality is largely 
provided by the use of the video message structure of the preferred embodiment and 
annotation additionally provides the user or some automated mechanism with one or more 
capabilities to operate on a labels) within a structure. Such operations may include 
addition of text or other material (eg. a sound effect), or operation of a function to modify 
one or more properties of said label (for instance highlighting of text, animation, font 
changes, etc). The purpose of annotation is typically to allow the user or an automated 
mechanism to show or record some statement or reference against a labelled node within 
a structure, said annotation indicating status or uses, intent or instructions aa described 
above for actions relating to a message. 

Annotation of a message by a user can be done to serve any of several functions: 
procedural signalling for future attention; piacernaiking and aiding memory; paraphrasing, 
summarising; etc* 

Another use of annotation may be the transcription of audio content. For instance, 
throughout the spoken text in a video message, there can be mention of items that are 
mote efficiently and more effectively represented in written text. For example, if a sender 
wishes to include a URL, then the sender may copy and paste the URL as a form of 
annotation which is typically more efficient and user-friend! y than including the same 
information in spoken form (for example, "(ft) a ^ c « tee tee nee colon slash slash double u 
double u double u dot 
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Video Message Attachments and Introductions 

Video messaging may include the capability to attach to, or include within a 
video message, video message structure, compound video message or any portion thereof, 
message content other tlian the primary video and/or audio message, ami also other than 
the video message structure for the purpose of creating a convenience for any potential 
user including providing an introduction capability or a particular perspective or other 
similar or related feature or capability concerning passive or active referencing of said 
attachment or inclusion. Hie convenience, refeicnce, perspective or introduction, whether 
passive or active, may be created and/or executed automatically or manually or by some 
combination of these. 

The convenience may be utilised in various ways, for instance, to create an 
introduction using video messaging and video message structure to another component of 
the message or a point therein or a part thereof (eg. a document or portion 01 point within) 
or in similar manner to an attachment to the message or to a referenced but non-included 
and non-attached portion a the message. Further, a plurality of such introductions or 
conveniences may be created, especially utilising the video message structure capabilities 
and also permitting manual and/or automatic navigation or access through or between or 
amongst these introductions or conveniences by a creatoi or by a viewer. 
Second Embodiment 

Referring to Fig, 12A, there is illustrated a second preferred embodiment of the 
invention in which a receiver system 1200 provides viewing capability for video 
messages and a message structure editor. The receiver system 1.200 can be described as a 
Receiving Station for video messages but this description does not imply a requirement 
that the station receive video messages, but rather provides a general description of the 
typical functionality and application of this embodiment 

The typical capability of the receiving station 1200 is to allow a recipient of a 
conventional linear (unstructured) video message to create or associate a structure of 
topics ibr a received conventional video message* Preferably, the structure of topics 
created or associated will correspond to the implied or inherent structure or content of the 
conventional linear video message. Once this structure of topics is associated with the 
conventional video message then additional capabilities will be available to the message 
recipient as described below. 

Ihe embodiment illustrated in Fig. 12A includes a video player 1202, typically 
associated with an audio player* both being shown within representative device 1201. 
The representative device is general purpose computing device 1201 (eg- a personal 
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computer). Alternatively a dedicated of embedded device designed to support the 
functionality as described with reference to the profit (second) embodiment. This 
embodiment includes a video and/or audio player substantially as described with 
reference to the first (preferred) embodiment for playing a video message rec^h/cd for a 
sender. The receiving station 12(10 includes 2 communication link 1204 to a computer 
network for receiving a the video message, Again, as described in the previous 
embodiment as optional communication technique rbr video message can be effected by 
storing the message on a removable storage medium, such as a floppy disk 1205, to be 
sent to the recipient by conventional methods (eg. post). The recipient can then insert the 
removable storage medium in a leader device (eg. a floppy disk drive) and access the 
video message and do with it as if it were received from the network It is envisaged that 
the receiving station 1200 is preferably implemented on a portable computing system 
such a "Palm Top* or "Lap Top* having a modem device (not shown in l ? ig. 12) and a 
wireless connection to the computer network. 

Referring now to Fig. 12B there is shown a dataflow diagram oerforaied during 
operation the receiving station 1200 of the present embodiment. The description of 
Fig. 12B parallels substantially the description of Fig. 1C excepting that components 
(modules) not essential to the second embodiment (it. the receiving station 1200) have 
been omitted from Tig, 12B. Additionally, Fig. 12 shows that video data is received 1204 
from a network 1301 to the communication manager 108 and the communication 
manager stores (via video data line 136B) Lhe received video data to a video data file 128. 
All corresponding compojienfc between Fig. 1C and Fig. 12B &ie as hereinbefore 
described with reference to Fig, 1C. 

The message structure editor for the receiving station 1200 is substantially 
similar to the message structure editor for the sending station 100 excepting that it 
provides substantially those function that pertain to manipulating a video message receive 
from an external source (ie. a sending station 100). Thus the receiving station 1200 
provides functionality for Labelling, navigating, editing, and annotating a viceo message 
by utilising a structural representation of the message or intended message. As for the 
sending station 100 the video message structure^ in the present embodiment, also 
icpiesents the themes or subject matters of a video message as they appear sequentially in 
time and, when appropriate, as Itsey are related from generic to specific in a hierarchical 
fashion. The video messaging (receiver) system allows recipients of video messages the 
following capabilities: 

(i) Video message labelling; 
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(ii) Video message navigating; 
(ill) Video message editing; and 
(iv) Video message annotating; 

This list of capabilities will be referred to in this document as "receiving station 
structured video message capabilities". 

The receiving station structured video message capabilities can be used, for 
examp!e T by a iecipienl to increase the number of useful functions applicable to a video 
message over those possible ouly when viewing a conventional, .linear video message. 
The recipient may use the video message sliucture for navigation,, labelling, and editing 
and other structured video message capabilities. Regardless of whether the video 
message structure was sent to the recipient or not, the recipient can make use of the 
structured video message capabilities, for example, creating their own message structure 
by labelling and then editing the video using this structure, A video message structure 
can be used for forms of automated processing of thai message. For example, a video 
message structure can be used to provide an index for a video message that cat* later be 
used to facilitate seaiching for message content. For another example, a video message 
structure can be used as a basis for routing a video message to a specific pasoa or role 
within an organisation (for example, as part of a call centre function). 

The receiving station video message structure and the associated functionalities 
and capabilities will now be described in detail, however it should be note that some of 
the capabilities and associated functionalities share some commonality to the list of some 
capabilities described with reference to the first embodiment of the present invention. 
Video Message Labelling 

Video message labelling allows a use* to create nodes within the video message 
structure representing a video message and to create labels (textual or otherwise) for these 
nodes. These nodes arc associated with, specific points or sequences in the video message 
and the label can be used to describe or augment Ihe video message content at that point 
or within that sequence. These labels can be used for subsequent navigation, editing, etc. 

The operations available to a user include the capability that nodes, and hence 
labels, can be associated with a specific position or sequence within an existing video 
message. The means for a user to indicate the specific position or sequence within the 
video message include the use of the current playing position of the video, user-marked 
iii-poiots and out-points, and any other form of indication of video positions or sequences. 
Video message labelling can be made available to the recipient of a video message to 
facilitate these or other forms of processing. 
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Video Message Navigating 

Video message navigating allows a user to cue to a position in the video message 
using the video message structure (for example, by clicking on a node in the video 
message structure, the playing of the video message could be cued to the corresponding 
position within the message), 

Doiing navigation, the display of the video message- structure can be manipulated 
by a user, for example expanding a node to show a sub-tree or collapsing a node to hide a 
sub-tree. 

The display of the video message structure can also be iaodified to provide 
feedback to (be user with regard to the current position within the video. For example, 
the current position within the video can be indicated on the vide-o message structure 
display by showing a Karaoke-style "bouncing ball 11 , or the node corresponding to the 
current position within the video could be highlighted hi some way. 

In addition* when a video message is being played, the label from the node 
corresponding to the current position in the video can be displayed near the video display, 
This can, for example, take the appearance of a caption below the video, above the video, 
beside the video or overlaid on top of the video. 
Video Message Editing 

Video message editing allows the user to manipulate the video message structure 
in order to delete a sequence in a video message, move a sequence in the video message 
to another location within the message, extract a sequence from a video message to be 
used in another message or be used by another application. 

The manipulating the video message structure without altering the video message 
and manipulating the video message structure when the objective is to perform an 
analogous operation on the corresponding video message is substantially as hereinbefore 
described with reference to Fig. 6 to Fig. 1 1. 

Vjdeo message editing can be made available to the recipient of a video message 
who benefits from being able to manipulate the message. The second embodiment allows 
the recipient to create a "customised" version of the message, enabling the recipient to 
comprehend^ act on and use the message for other purposes. 
Video Message Annotating, Video Message Attachments and Introductions 

Video message annotating, video message attachments and introductions for a 
receiving station 1200 can be described in the same manner as that previously described, 
wim reference to the corresponding section, for the first embodiment of the present 
invention. 
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Third lii.ibodi merit 

Fig. 13A illustrates a third embodiment of the Invention in which the ftrst and/or 
second embodiment further include a capability to send and/or receive an associated video 
message structure with a video message. The ihirci embodiment is hereinafter referred to 
as a video message communication system 1300 and whilst for clarity Fig. i.3A shows a 
sending station 100 connected to a receiving station 1.200 via a computer network 1301, it 
is envisaged that each "station" (ie: sending and/or receiving, staliou) on the network 1301 
performs a dual function corresponding to both a sending station 100 and receiving 
station 1200. That is> preferably each user has the ability to both send or receive a video 
messages and manipulate, the messages in a manner described with reference to the 
sending station 100 or the receiving station 1200 respectively. Thm in the preferred form 
of the present embodiment the ftisL and second embodiment combine to provides capture 
capability for video messages, viewing capability for video messages, one or more 
message structure editors as well as the capability to send and/or receive an associated 
video message structure. 

The video message communication system 1 300, at the sender end, may be used 
to capture, create and send video messages and also send an associated or related video 
message structure along with the linear ("unstructured) video message. The video message 
structuic allows a recipient of the video message, having the capabilities to view the 
message as a receiving station 1200, (o view a structured video message as intended by 
the sender. That is, the recipient can view and/or navigate through the video message 
using the video message structure scat to the recipient by the sender Optionally, the 
video message communication system 1300, at the sender end can send the linear 
(unstmctured) video message without an associated or related video message structure for 
the message in which case the video message communication system 1300 operates as 
sending stations 100 and/or receiving stations 1200, whether in combination or not, 
connected to a computer network 1301 as described with reference to the first and second 
embodiment. 

Thus, the present {third) embodiment of the present invention advantageously 
provides a mechanism for communicating a desired video message structure in addition to 
the linear (unstructured) video message. Preferably, the desired video structure is a 
predetermined encoded representation thai is separate from the linear (unstructuied) video 
message itself. However, a video message structure itself, or parts there of, need not be 
sent by the sender to the recipient along with the linear (unshuctured) video message, the 
sender may, for example, send & reference address (eg. a Uniform Resource Locator 
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URL) from where the video message structure can be obtained The video message 
structure is separate from the linear (unstructured) video message so that the video 
message corrrrnunication system 1300 of the present embodiment can communicate to a 
conventional (or unstructured) linear video messaging system by sending the linear 
(unstructured) video message without the associated video message structure. However, 
the video message communication system 1300 can also be implemented using a 
combined and inseparable video message and video message structure (also referred to 
hereinafter as a "combined video message 1 *) without depaittng from the scope and spirit 
of the invention. For example, an encoded representation can be used that encodes the 
message structure together (inseparably) with the video message. 

The typical functionality and properties of the video message comitiunication 
system 1300 allow enhanced capabilities for the sender of a video message and also for 
the recipient of a video message beyond those available or possible with conventional 
linear video messaging systems. 

Fig. 13 A shows a computer network 1301 such as Internet (or Intranet) as a 
mode of communication between users of the video message communication system 1300, 
however other modes of data transfer can be used. For example, as described in the first 
embodiment a removable storage device can be used as mode of communication between 
users of the video message communication system 1300. In addition, it is> fioi a 
requirement of the present embodiment that the linear Video message be sent to a recipient 
via the same mode of conimunicatiou as that used to transmit an associated video 
message structure. Further, there is no restriction on the number or interconnected 
component sub-systems (stations whether sending 100 or. receiving 1200 or stations 
combining funetioaality of both sending and receiving stations} that can be included as 
part of the video message communication system 1300. 

Referring now to Fig, 138 there is shown a dataflow diagram for operation 
performed by the video message communication system 1300 of the present (third) 
embodiment. The description of Fig. 13B parallels substantially the description of 
Fig. 1C combined with the description of Fig. 123 and therefore Fig. 1.3B includes all the 
components (modules) of both Fig. 1C and Fig, 12B. In addition Fig, 13 in shows that a 
video message structure according to the present embodiment can be communicated via 
connection line 137A to the communication manager 108 which in torn transmits an 
associated video message structure along with the video data to a computer network 13U1 
(ie, transmit video message). The transmission of the video message structure typically 
occurs when video message communication system 1300 is in sending mode or acting a 
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sending station That is, a sender is to send a video message. At a receiving end of the 
video message communication system 1300, if both video data and the associated video 
message structure is received, the communication manager 108 separates the video 
message into the data and structure and stores the video data (via a video data bus/line 
136B) into the video data file 128 and the video message structure (via a video structure 
bus/line 137B) into the video message structure file 122 respectively. Alternatively, the 
receiving station end of the video message communication system 1300 may receive just 
the video data (ie: the video message without the associated structure), in which case the 
communication manager 108 directs 136B the data to the video data file 128 for storage 
and the recipient may then manipulate and/or view the video data as described with 
reference to the second embodiment of the present invention. 

All components of Fig 13B in common (ie having the same reference numeral } 
to Fig. 1C and/or Fig, 12 B have substantially the same description attributed to them as 
hereinbefore described with reference to Fig. 1C and/or Fig 12B. 

The third preferred embodiment includes one or more of the capabilities and/or 
properties listed and described with reference to the first and second preferred 
embodiment. As previously noted, in practise, it is desirable that each user, of the video 
message communf cation system 1300, have the capability perform a dua] function, as 
sending and receiving station and thus all the capabilities available to ihe sending station 
100 and the receiving station 1200, without duplication of capabilities in common to both, 
are desirable. B*plicidy, a desirable list of capabilities for the video message 
communication system 1300 include; 
Video message planning; 
Video message capturing; 
Video message labelling; 
Video message navigating; 
Video message editing; and 
Video message annotating. 

The list representing a union of the set referred to as the sending station 
structured video message capabilities and the set referred to as the receiving station 
structured video message capabilities, 

The video message communication system 1300 comprises transmission and 
reception capability for a video message, a video message structure or a compound video 
message preferably in any one or more of the following forms; 
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* Transmission and reception of a conventional linear video message without any 

explicitly or implicitly referenced video message structure. This case may 
typically resolve to one or more instances of the first and/or second preferred 
embodiments), 

"Transmission and reception of a conventional linear video message with an 
accompanying or separately transmitted and/ot" received video message structure 
whether or not cither the video message or video message structure is explicitly 
or implicitly (by reference or alike) included. The video message structme can 
be partially or incrementally sourced from a third party, machine or location 
(typically by some implicit or explicit reference). 

• Transmission and reception of a video message structure without any explicitly or 

implicitly referenced video message. 
Fourth Embodiment 

A fotnih embodiment of the invention is described substantially as the first 
embodiment excepting that no communication is sent to a recipient Fig 14 therefore 
shows a drawing substantially similar to Fig. I A excepting no network communication 
line or connection is shown. That is, the video message is captured in the same manner as 
that described with reference to the first embodiment but rather than send the message to 
another user the message (and/or associated video message structure) is stored on a local 
storage device (eg, hard disk drive) for personal use. Far example, as a memorandum for 
personal use or future reference. Whilst storage of the video message and/or video 
message structure on a local storage device is preferred, the present embodiment can 
operate by storing the video message (and/or video message structure) at a remove 
location on a computer network server for retrieval at a later date. Whilst storing the 
video message at a remove location may include sending of ihc video message^ the 
message is not intended for use by another user (recipient) as is the case in the first 
embodiment 
Fifth Embodiment 

The fifth embodiment is described substantially as the first embodiment, the 
second embodiment, the third embodiment or the fourth embodiment of the present 
invention with at least one additional feature. This additional feature is the addition or 
application of video message templates to any one of the previous embodiments or parts 
thereof. The video message template is used, amongst other uses described hereinafter, to 
generate the video message structure and is interchangeably referred to hereinafter 
instantiating the video message template. In the present (fifth) embodiment, where in the 
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previous embodiments) the video message shucture was transmitted from sender to 
receiver, rather than send the video message structure (jc. an instantiation of [he video 
message template) to a recipient, the video message template ilself is sent along ibe linear 
video data. Thus, the recipient can therefore instantiate the template to provide a 
substantially similar video message, structure as that used by an originator of the video 
message. Optionally, recipient can use the received template; generate a customised video 
message structure thereby customising the message to the recipient's user prefeieuce 
whilst still receiving (viewing ) substantially the same message. For example, t3ie user 
preferences may include customising a "look and feel s> of the output interface (display). 
A further example may include customising a video message structure to provide a minor 
rearrangement of the structure so thai a "summary section" of a video message is 
presented before a ''main section" should a recipient desire so even though it may not be 
the same order the originator had contemplated, 

Alternatively, a video message template can be stored at a predetermined 
location, such as a server on a computer network, having a reference location address (eg. 
uniform resource locator URL) and transmit to a recipient of a video message the linear 
video data along with the reference location address without departing from (tie scope and 
spidt of the invention. 

Typically, a template in a computational or equivalent system such a computer 
system can be defined as: 

* a pre-defined structure available for re-use, or 

* a grammar for a class of such structures. The grairmiar dictating the rules for well- 

formed instances of this class. 

The template definition described above should in no way be taken as limiting on 
the present invention and is merely an exemplary defiiiition of desirable features of a 
template. For example a template can be generated for a single use and then discarded. 
Additionally a template may include rules governing message intent, message structure 
and/or message attributes (attributes include duration of; video clip, font type and size for 
text labels, and parameters for adjusting colour and general appearance of a GUI 
application etc). 

Preferably, a template is a repository of ex|>erjsnces as to best practice ("best" 
including any one or more of the following: most economical, most efficient, most 
effective, etc depending on the context). The best practise is encoded into a template and 
reflects the practise of au experienced sender of messages. Thus, for example, most 
effective may reflect a most effective way of creating, sending or receiving a 
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memorandum so as to get the message being commumcsted across in an effective manner. 
This can be performed by a template guiding the user to produce a memorandum using 
the skills of «n experienced person while the user may be quite inexperienced at memo 
writing. Thus, in this context, a desirable feature of a template its re-oseabiiiiy, either by 
its creator or by another user(s). 

Tabie 1 matches a purposes of a (video) message structure and of templates for 
each one of a plurality of major classes of functionalities of video messaging systems. 
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Video Messaging System functional! lies : this column of table 1 lists «he 
various functionalities available to a sending station 1U0 1 a receiving station 1200 and/or a 
video message system 1300- 

Purpose of message structure in video messaging systems without templates; 

this column of table 1 indicates the purpose of a video .message structure in video 
messaging systems without templates. For example, in viewing the message by the 
recipient (row 5 of table I) the structure is used to "view on message" (row 5, column. 2 of 
table 1) that is to allow the user to access the message a different points on the structure. 
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Purpose of m plate as different rrvm message structure: this column of table 
1 indicates the purpose of the template as different from the video message structure: Tor 
example, in viewing the message by the recipient (row 5 of tabte 1) a template can 
provide guidance as to what the sender considers best practice, guidance as to the 
hiteipretation of the message atid/or efficient processing of message content 

Part of template used: this column of table 1 indicates what part of the template 
is used. Thai is a message template can be multi-functional and provide different features. 
For example, in viewing the message by the recipient (row 5 of table 1) a template can 
provide: message intent (eg, propose a meeting), structure, other attributes such as "tone 
of message'* (eg. friendly, anihorxtative etc). 

Necessity of links between message structure and message content; this 
column of table 1 indicates whether or not a link or links between the mcsssgc content 
and the video message structure. 

Thus, table 1 shows that the main contributions of templates as distinct from 
structure include: 

* The provision of guidance. Capture or creation of a video message may he a 

potentially intimidating technology for the sender. To address this, templates 
can act, fo* the sender, as a guiding repository of "best practices". 

* The use of message intent as metu-data for message management functions. 
From the framework provided by the present embodiment, it is desirable that video 

message templates include the following template functional, types: 

* A template may provide a default video message structure of a message. The 

template provides 2 typical message structme, which is presented to the sender 
and which the sender "Gils out" or applies to a specific message at capture time. 
Under this meaning, the user would choose a template from a set, and would 
then record the message following the structure suggested by the template. 
Preferably, the template's purpose m this context is. guidance, if the structure of 
the template is linked to the message contents, then the template can also be 
used for message management functions. 

* A template may provide a default video message structure with associated 

default message attributes. Here, the user would choose a template from a set 
and this would bring up an appropriate message structure and attribute set. The 
user would then record the message following the structure and attribute values- 
suggested by the template. As in the previous case above, the template's 
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purpose here, without restriction is guidance but it may also be useful for 
message management functions, if the appropriate links are created, 
* A template maj provide cither of the above-described functionality witli the added 
restriction that Its structure and attribute functions may he, in pan or whole, 
unchangeable. Here, a template is analogous to a set message form, whose 
cortlent is video rather than (ext. This is useful m eases where the recipient of 
the message needs to process the message in ore-determined ways, such as the 
example of call centres. The template's purpose here, without restriction, 
includes; guidance and facilitating the processing of the message. Message 
management functions can also be performed in this case, structure and content 
being linked. 

In the first two bullel points above, a desired purpose of the template's purpose is 
to provide guidance to a ttser, and resulting messages may thus have different video 
message structures (and, optionally different attributes for the second of the first two 
bulkt points above) although produced with tbe aid of the same template. Optionally, 
these structures could, in turn, be used to define new templates. 
Templates for i he Sender 

An example of control flow for usex creation, navigation and/or editing is now 
described with reference to Fig. 15. 

Initially, during the message planning su?*>, the sender chooses 1501 a template 
from a set. The template includes relevant information which can be included in a video 
message and details of one of a predetermined set of most appropriate message structures 
and attributes of the video message. Next 1.502 the video message communication system 
1.300 prompts the user with the selected template according to whether the user is 
performing a video capture, navigation through an existing video message or data, axid/or 
editing a current video structure. For example,, during execution of the video message 
capture, the chosen template and attributes provide a guide (or prompt) to a user (a 
sender). Preferable, the template further maintains a flow of information, by prompting 
the sender (eg. much like slides in a seminai) to the next couise of action. No links are 
necessary between a video message structure (ie. an instantiation of the template) and 
video message content at this stage, but these links can he beneficial the user (sender) as 
message management ^notions. As previously described the video message content and 
video message structure linking can be done using tirnestamps or other references into a 
captured piece of video, and may be performed either during the recording of the video 
message* or afterwaids. For example, while recording a video message, a sender execute 
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a template, using an input device such as a mouse (clicking on the part that is being 
recorded) or a keyboard (arrow keys), At step 1502 the template is instantiated to provide 
a video message structure associated (linked ) to a captured video message data. 

Next in the steps of the flow control of Fig. 1 5, the user is given one of two 
options according to the previously described functional types of the selected temptate 
(step 1S01). 

The two options include: 
Option 1, step 1503, the type of selected template allows the video message 
structure resulting from the template (ie. instantiated template) to be modified and 
the use* can: 

a) change the video message structure itself; aad/or 

b) change attributes; or 

Option 2, step 1504, the selected template is of functional type "unchangeable" and 
therefore part or all of the instantiated template cannot be changed (modified) by 
tlie user (typically a sender), 

Option 2 is advantageous, for instance, where it is desirable that the video 
message structure used by a sender (originator of a video message) be substantially the 
same as the instantiated template (ie. video message structure) used by a recipient of a 
video message- 
In step 1503, links are created between nodes of a video message structure and 
video data segment, preferably at lime of captuie of the video data or at editing a video 
message. In option l 7 step J5G3 T a user is free to create further links or remove as many 
links as desired in creating or editing a video message. Thus, a next step 1505 allows the 
user create new links or change existing links between video data and associated video 
message structure. One of two paths in the flow control is taken depending on whether oi 
not links exist between the video message structure and the video data If no links exist a 
fitsi path is taken and the video data is sent 1506 and the flow control follow to a further 
step 1507 where the user is prompted to decide whether a current instantiation of the 
template is to be saved as a new template. To which if Ihe user responds with '"yes" a 
new template is store otherwise no new template is saved. 

At step 1505, if at least one link does exist between the video message structure 
and the video data a second pa£h is taken in the flow control to step 1508 where the user is 
given the option to annotate the video message structure. Next 1509 the video data and 
template/^) is (are) sent to and received by a recipient as a video message. The recipient 
can instantiate the received teropla(e(s) and use the resulting video message structure as 
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an index into the video data of the video message, A copy of the video message Is 
preferably stained by the originator (sender) and can also use the instantiated message 
template as an index into the video data of the video message (step 1510). The flow 
control in, now, directed to step 1507 and if any changes to the video structure was made 
in step 1505 then user is given the option to save the instantiated template as a new 
template as previously described with reference to step 150?, 

If option 2, step 1504, is taken following step 1502, that is the selected template 
does not allow modification to part or ali of an instantiated template, links are created^ 
either by the selected template or by requiring a user to create necessary links as governed 
by the selected template, between predetermined nodes of the instantiated template and 
one or more segments of the video data. Links between predetermined nodes of a current 
instantiation of the video message template and segments of an associated video data 
must now exist as required by the selected template. Thus, the flow control is directed 
through steps 150S to 151.0 and step 1507 as previously described with reference to these 
steps. 

Note that for navigation and editing, the three* previously-described template 
functional types may bring no additional functionality or benefit omer than those already 
covered by the provision of message structure, however, by extending templates to 
include some form or forms of interactivity a user can have, for the navigation and editing 
user tasks, additional functions including user-prompting, automatic or semi-automatic 
enhancements and efficiency improvements, auto-correction, user-anticipation and other 
facilities. 

Further, the sende* preferably given the capability or option to change some or 
all of the various template parameters or attributes. There is therefore a distinction 
between the template itself and its instantiated sttucture and a modification to each differs 
as follows: a modification to a template will invoke the same modification in a 
subsequently- mm titrated structure or structures; whereas a modification to a structure 
will have no impact on any template that it might have been instantiated from and 
therefore will have no effect on any further structure that might be instantiated from the 
modified template. Changes to an instantiated structure may or toay not be reflected as a 
template modification or as a new template. 

Table 2 matches a purpose of a (video) message structure and of templates for 
each one of a plurality of major classes of functionalities of video messaging systems for 
the sender (a subset of table 1). 

fable 2 
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Video Messaging 

System 

functionalities 


Purpose of 
message 
structure m 
video messapiiifi 
systems without 
templates 


Purpose of 
template as 
different from 

structure 


Part of 
template used 


Necessity of 
links between 
message 

message content 


Planning a 
message 


Note-jotting for 

completion, 

coherence 


Guidance ss to 
best practice 


Stmciure, oihei 
attributes 


No 
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Creation of a 
message 


Note-jotting for 

completion, 

coherence 


Guidance as to 
best practice 


Structure, other 
attributes 


No 


Editing of a 
message by 
sender 


View on 
message, direct 
access lo 
message content 


Prompting or 
guiding sender as 

to optimal 
structure^ order, 
etc. 


Ft? tent, structure, 
otaer attributes 


Yes 


Navigation within 
a message by 
sender 


View on 
message, direct 
access to 
message content 


Prompted or 
automated 
navigation based 
on template 
mlejit* etc* 


Intent* structure, 
other attributes 


Yes 


Viewing of a 
message by 
sender 


View on 
message 


Efficient 
processing of 
message content 


Structure 


Yes 


t\Jm tk ti l> p 1 ! r»r* 

ivj.&*jsa|£e 
management 
functions: storing, 
accessing, 
retrieving a 
message 


Me ta -data 


Me i a- data 


Intent 


Yes 


Annotation of a 

message 


View on 
message 


Prompting or 

optimal 
annotation 
method, 
annotation 
points), etc. 




Yes 
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Templates for the recipient 

Th& video messaging communication system 1300 (or receiving station 1200) 
would allow the recipient to receive, accompanying or referenced within a message, a 
video messaging template which was used to construct the video message or portion 
thereof. 

For the recipient, the template nets as a support mechanism dining three s*ages, 
the first two of which - planning and creation - - arc very similar to those described in the 
previous section "template for the sender' , \ with the exception that the sending station 
creates * link from a template to a corresponding section of the video message. During 
Ihe viewing stage, the template preferably provides the recipient, with any or all of (be 
following key advantages: 

* Provide a more coherent How of information, by including, providing and/or 

accessing placeholders in the message which act a«i a guide to the message, 
Preferably, an advantage the recipient's is the ability to see the structure of the 
content of the entire message, its explicit intent, attributes, etc. This may allow 
the recipient to: 

* Form a global view of the message, which is particularly beneficial 
in the case of a video-based communication medium. 

* Reduce the risk of misinterpreting the message, due to the explicit 
message intent and dialogue function. 

* Provide advantages to the recipient that were already described as available from 

video message structures that are also available from video message templates, 
potentially including additional capabilities: 

* Editing of messages, possibly filtering out some of message sections 
and re-sending others as part of other messages. The benefits of the 
template here include ensuring that the constraints for the original 
mes&age are respected in the edited version as well as potentially 
providing context information, etc that may not be obvious rjrom a 
video message structure alone, 

- Navigating through a messa<re(s). For example, this will allow the 
recipient to skip to a particular part o£ the message that the recipient 
finds most useful or interesting. 

* Extracting of particular section(s) of relevance from message^), and 
potentially using it or them in a reply or replies to the sender of 
senders or in other message(s). 
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♦The capability to augment arid modify one or more templates. For example, a 
recipient who is a new user of a video messaging system may adopt a sender's 
template for organising a meeting, and subsequently modify that template. The 
template may act as a '*best practice" repository. 

* The potential for integrating workgroup functions, where a set of people needs to 
share templates for a set of specific tasks. Again, the template may act as a 
"best practice" repository, and enabling the uniform processing of messages. 

*The recepdon of the template by the recipient can enable the efficient processing 
of message content in cases when tins processing requires explicit action from 

* 

the recipient. Here, the template is considered as a type of "form* ' which the 
sender must follow. Therefore, in the present (fifth) embodiment the template's 
role is then to ensure that the tecipienl knows a priori what information will be 
sent and how that information is structured, where to look for specific 
information, etc. The recipient can thus anticipate efficient ways to handle the 
message. 

Referring to Table 3 there is shown a pucposes of a (video) message structure 
and of templates for each one of a plurality of major classes of functionalities of video 
messaging systems for the sender (a subset of table 1). 
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Table 3 



Video Messaging 


Purpose of 


Purpose of 


Part of 


Necessity of 


System 


message 


template as 


template u$e<l 


links between 


fui ictionaltties 


structure in 


different from 




message 




video messaging 


message 




structure and 




systems wit it out 


structure 




message content 




templates 








Viewing of a 


View on 


Guidance as to 


Intent, structure, 


Yes 


inebooge oy 


EjJCSSilgC 


wiJuL senuer 






recipient 




cons i tiers b?:si 


OK 








nractiee OR 










fill irlan/"*** r*c t Oi 


Intent, other 








the interpretation 


attributes OR 








of the message 










OR 




















Efficient 










processing of 










message content 






liditing and 


View on 


Guidance as io 


Intent, structure, 


Yes 


Filtering of a 


message 


what sender 


other attributes 




message by 




considers best 






recipient 




practice 






Navigation within 


View on 


Efficient 


Structure 


Yes 


a message by 


message 


processing of 






recipient 




message content 






Message 


Meta-data 


Meta-daia 


Intent 


Yes 


management 










functions: storing. 










accessing, 










retrieving a 










message 
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Template for Message Management 

While templates typically do not specify information about the exact content of a 
video message, they do provide some informatioii about the content, especially regarding 
the type of the message, tn particular, the message intent {eg,, propose meeting, seminar 
announcement, etc.) of the template used to produce a message is indicative of the type of 
information that is contained in the video message. The message Intent is a template 
element that: is likely to be useful, for indexing purposes. Exploitation of the message 
intent allows searches such as, for example "find the messages about seminar 
announcements"* Searches might be undertaken addressing other attributes of a template,, 
possibly including combinations of attributes. 

The message intent, oi template intent, can thus serve as meta-data to a derived 
video message or compound video message, in addition to other data such as the date and 
the recipients. Like any meta-data, the message intent or template intent can therefore be 
used as an index to help in searching for and retrieving a specific message. 

A message my include several "fields": An address field, where the address of 
the recipient is entered to send the video message; a subjsc* field where a brief description 
of the subject matter of the message is inserted, if desired; a carbon copy field is used to 
send copies to other recipients; an attach message field which includes a refexencc to 
other documents or video messages; and a date/time field for storing the date andyor time 
the message was sent by the sender. Those skilled In the art will recognise that other 
fields can be included without departing from the saope and spirit of the invention. For 
example, another tietd can be a priority field indicating a degree of urgency of the video 
message. 

To search, for example, messages about seminar announcements: the subject 
field of an email message (whether video or text-based) could be any one or more of the 
following: 
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r <Namc> seminar, 

* Date: Dr. XX on "topic" 

* A talk on "topic" by Dr XX 

* Mark your calendar: Dale 

A search for "seminar announcements" might retrieve a message with the subject 
such as the first one given above, but will not be able to recognise the other messages as 
seminar announcements based on the Subject field. On the other hand, if the messages 
were created with a "seminar announcement"* template, they would all be readily found. 
It is envisaged that the reliability of this template intent for searching purposes depends 
on the usage the sender made of the template. In. a situation in which the template 
structure cannot be changed nor edited, the template intent can reliably be used for 
indexing. 

Video Message Transmission 

In mis embodiment it will be typical that a created video message may be 
transmitted and received by a variety of tech that may also include or imply a message 
structure or message template or parts thereof or references, etc as indicated by these 
examples: 

* Video message including sendees video message template which uiay be used 
to instantiate a video message structure at the receiver; 

* Video message including sender's instantiated video message structure or 
reference or implication to said video message structure {both as described in 
the third preferred embodiment); 

* Video message mctuding a reference or implication or equivalent to, but not 
explicitly including, the sender's video message template; 

* Video message including a portion or modification or incremental change to 
sendees video message template, the latter being refeienced or implied but not 
explicitly included. 

Preferred Embodiment of Apparatuses 
The embodiments) of ihe video messaging system (sending station 100, 
receiving station 1200 and/or video message communication system 1300) are preferably 
practiced using a conventional general -purpose computer such as the one shown in 
Fig. l<>, wherein the video messaging system can be implemented as software executing 
on the computer. The software can be divided into two separate parts; one part for 
carrying out the operations of the system; and another part to manage the user interface 
between the latter and the user. The software- can be stored in a computer readable 
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medium, including the storage devices described below, for example . The software is 
loaded into the computer from the computer readable medium, and then executed by the 
computer A computer readable medium having such software or computer program 
recorded on it is a computer program product. The use of I he computer program product 
in the computer preferably effects an advantageous apparatus for video messaging system 
in accordance with the embodiments of the invention. 

The computer system 1600 comprises of the computer 1601, a video display 
1614, and input devices 1602, 1603 and 1611* In addition, the computer system 1600 can 
have any of a number of other output devices including line printers, laser printers, 
plotters, and other reproduction devices connected to the computer 1601. The computer 
sysiern 1600 can be connected to one or more other compulse via a eommunicatiou 
interface 1612 using an appropriate communication channel 1630 such as a modem 
communications path, a computer network, or the like. The computer network preferably 
includes a local area network (LAN), a wide area network (WAN), an Intranet, and/or the 
Internet. 

The computer 1601 Itself comprises of a central piocessing unit(s) (simply 
referred to as a processor hereinafter) 1605, a memory 1606 which can include random 
access memory (RAM) and read-only memory (ROM), input/output (lO) interfaces 1608 
and 1610, a video interface 1607, and one or mom storage devices geueially represented 
by a block 1609 m Fig. 16. The storage dcvice(s) 1609 can include of one or more of the 
following: a floppy disc, a bard disc drive, a ma#neto-oplioat disc drive, CD-ROM, 
magnetic tape or any other of a number of nonvolatile storage devices well known to 
those skilled iu the art. Each of the components 1605 to 1610 and 1612 is typically 
connected to one or more of the other devices via a bus 161 4 that in iurn can include data, 
address, and control buses. 

The video interface 1607 is connected to the video display 1 604 and provides 
video signals from the computer 1601 for display on the video display 1604. User input 
to operate the computer 1601 can be provided by one or more input devices. Foi" example, 
an operator can use the keyboard 1602 and/or a pointing device such as the mouse 1603 
to provide input to the computer 1601. Additionally, input, such as video, can be effected 
via a video camera 1611 and corresponding input interface circuitry 1610. 

The system 1600 is simply provided for illustrative purposes and other 
configurations cait be employed without departing from the scope and spirit of the 
invention. Exemplary computers on which the embodiment can be practiced include 
IBM-FQATs or compatibles, one of the Macintosh ™ family of PCs, Sun Sparcstation ™, 
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or the like. The foregoing are merely exemplary of the types of computers with which the 
embodiments of the invention can be practiced. Typically, the processes of the 
embodiments, described hereinafter, are resident as softwaie or a program recorded on a 
hard disk drive (generally depicted as block: 1609 in Fig. 16) as the computer readable 
medium, and iead and controlled using the processor 1605. Intermediate storage of the 
program and pixel data and any data fetched from the network can be accomplished using 
the semiconductor memory 1606, possibly in concert with the hard disk drive 1609. 

In same instances, the program can he supplied to the user encoded go a CD- 
ROM or a floppy disk (both generally depicted by block 1609), or alternatively could be 
read by £he user from the network via a modem device connected to the computer, for 
example. Still further, the software can also be loaded into the computer system 1600 
from other computer readable medium including magnetic tape, a ROM or Integrated 
circuit, a magneto-optical disk, a radio or infra-red transmission channel between the 
computer and another device, a computer readable card such as a PCMCIA card, and the 
Internet and Intranets including email transmissions and information recorded on websites 
and the like. The foregoing are merely exemplary of relevant computer readable 
mediums. Other computer readable mediums can be practiced without departing from the 
scope and spirit of the invention. 

The embodiments can alternatively t>e implemented in dedicated hardware such 
as one or more integrated circuits performing the functions or sub functions of the video 
messaging system. Such dedicated hardware can include graphic processors, digital 
signal processors* or one or more microprocessors and associated memories. 

The foregoing only describes a small number of embodiments of the present 
invention, however, modifications and/or changes can be made thereto by a person skilled 
in the art without departing from the scope and spirit of the invention, 
4 ♦ Brief Description of the Drawings 

Fig. 1A is a drawing showing a sending station in accordance, with the fust 
embodiment of the present invention; 

Fig. IB is a block diagram showing components of the sending slation of Fig. 

1A; 

Fig. 1C is a block data flow diagram of the components the sending station of 
Fig IB in more detail; 

Fig. ID is a state transition diagram of a message structure editor of Fig 1C; 

Fig. 2 is a diagram showing a graphical user interface GUI of a video player for 
the embodiments of the present invention; 
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Fig. 3 is a diagram showing a graphical user interface GUI of a Message 
Structure Editor illustrating thereon a collapsed video message structure in accordance 
with embodiments of the present invention; 

Fig. 4 is the GUI of Fig, 3 illustrating thereon a partially expanded video 
message structure; 

Fig. 5 is the GUI of Fig. 3 illustrating thereon a fully expanded video message 
structure; 

Tig. 6 is the GUI of Fig. 5 illustrating tlicrcon a expanded video message 
stiuctuie showing labelled node of a video message stiucture prior to deletion; 

Fig. 7 is the GUI of Fig. 6 illustrating thereon a expanded video message 
structure showing labelled node selected for deletion; 

Fig- 8 is the GUI of Fig. 7 illustrating thereon a expanded video message 
structure showing labelled node prior to deletion; 

Fig. 9 is the GUI of Fig. 8 illustrating thereon a expanded video message 
structure showing labelled node prior to a move operation; 

Fig. 10 is the GUI of Fig. 9 Illustrating a labelled node selected for a move 
operation; 

Fig, 11 is the GUI of Fig, 9 illustrating the video message structure after the 
move operation; 

Fig, 12A is a drawing showing a receiving station in accordance with a second 
embodiment of the present invention; 

Fig. 12B is a block data flow diagram of the cotnpoue*its the receiving station of 
Fig 12A in more detail; 

Fig. I3A is a drawing showing a video messaging communication system in 
accordance with a third embodiment of the present invention; 

Fig, 13B is a block data flow diagram of the components the video messaging 
communication system of Fig 1 3 A in more detail; 

Fig. 14 is a drawing showing a station in accordance with a fourth embodiment 
of the present invention; 

Fig. 15 is a flow control diagram for an example of video message templates in 
accoulance with a fifth embodiment of the present invention; and 

Fig. 16 is a diagram showing a general purpose computer upon which the 
embodiments of the present invention can be implemented. 
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1 . Abstract 

A method and system (100) for conveying a video message is disclosed Video 
data comprising at least image data and associated audio da*a is captured and a video 
message structure (401) is created. A link is established between tlic structure (401) and 
the video data to create a structured video message. The structured video message is 
characterized by a video message structure (401) that provides an originator (X03), oHae 
message, enhanced manipulation capabilities for. the video date by manipulating the 
structure- (401). The .structured video message can bss conveyed to a recipient for viewing 
and/or for providing the recjpicut substantially the same enhanced manipulation 
capabilities, 

2 , Representative iDrawing 

FiG LA 



BNSDOCID: <JP_._2000232635A_ L> 



